-- Logs begin at Wed 2022-08-17 07:53:54 UTC, end at Wed 2022-08-17 08:57:29 UTC. -- Aug 17 08:29:36.191349 dv-cinder-853315-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 17 08:29:36.200224 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 17 08:29:36.201801 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 08:29:36 2022] *** Aug 17 08:29:36.201801 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 08:29:36.201801 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 08:29:36.201801 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: nodename: dv-cinder-853315-5-iscsi Aug 17 08:29:36.201801 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: machine: x86_64 Aug 17 08:29:36.201801 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: clock source: unix Aug 17 08:29:36.201801 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: pcre jit disabled Aug 17 08:29:36.201801 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: detected number of CPU cores: 4 Aug 17 08:29:36.201801 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: current working directory: / Aug 17 08:29:36.201801 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: detected binary path: /usr/bin/uwsgi-core Aug 17 08:29:36.202433 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: your processes number limit is 47680 Aug 17 08:29:36.202433 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: your memory page size is 4096 bytes Aug 17 08:29:36.202433 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: detected max file descriptor number: 2048 Aug 17 08:29:36.202433 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: lock engine: pthread robust mutexes Aug 17 08:29:36.202433 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: thunder lock: enabled Aug 17 08:29:36.202433 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 17 08:29:36.202433 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 08:29:36.240979 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: Python main interpreter initialized at 0x55859a4689c0 Aug 17 08:29:36.240979 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: python threads support enabled Aug 17 08:29:36.240979 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: your server socket listen backlog is limited to 100 connections Aug 17 08:29:36.240979 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: your mercy for graceful operations on workers is 90 seconds Aug 17 08:29:36.241364 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 08:29:36.241364 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: *** Operational MODE: preforking *** Aug 17 08:29:36.241638 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: *** uWSGI is running in multiple interpreter mode *** Aug 17 08:29:36.241638 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: spawned uWSGI master process (pid: 105761) Aug 17 08:29:36.241833 dv-cinder-853315-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 17 08:29:36.242379 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: spawned uWSGI worker 1 (pid: 105762, cores: 1) Aug 17 08:29:36.242702 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: spawned uWSGI worker 2 (pid: 105763, cores: 1) Aug 17 08:29:36.242873 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 08:29:36.897755 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 08:29:36.901623 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 08:29:37.974041 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 08:29:37.974041 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: from cryptography.utils import int_from_bytes Aug 17 08:29:37.974613 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 08:29:37.974613 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: from cryptography.utils import int_from_bytes Aug 17 08:29:37.975250 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 08:29:37.975250 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: from cryptography.utils import int_from_bytes Aug 17 08:29:37.975718 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 08:29:37.975718 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: from cryptography.utils import int_from_bytes Aug 17 08:29:40.454372 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 08:29:40.454928 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 08:29:40.455136 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 08:29:40.455498 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 08:29:40.455786 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 08:29:40.456175 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.456501 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.456829 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.457177 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.457511 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.457822 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.458142 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.458466 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.458792 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.459049 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.459362 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.459709 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853315-5-iscsi {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.460034 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.460341 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.460650 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.460969 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.461273 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.461592 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.461897 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.462075 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 08:29:40.462532 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 08:29:40.462621 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.462826 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.462914 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 08:29:40.463133 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.463235 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 08:29:40.463445 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 08:29:40.463558 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.463808 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.463908 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.464119 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.464221 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.464428 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.464515 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.464747 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.464837 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.465057 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.465157 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.465376 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.465462 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.465683 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.465779 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.466029 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.466123 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853315-5-iscsi {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.466359 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.466447 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.466621 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.466709 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.466936 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.467025 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.467260 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853315-5-iscsi {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.467405 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.467611 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.467701 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.467923 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.468020 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.468260 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.468515 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.468609 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.468923 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.469092 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.469246 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.469556 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.469661 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.469944 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.470047 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.470272 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.470360 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.470599 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.470687 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.470924 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.471011 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.471233 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.471322 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.471560 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.471664 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.471881 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.471968 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.472203 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.472291 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.472510 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.472645 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.472815 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.472910 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.473067 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.473162 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.473377 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.473515 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853315-5-iscsi {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.473699 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.473833 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.474019 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.474149 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.474344 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.474464 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.474597 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.474849 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.474936 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.475169 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.475257 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.475478 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.475587 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.475813 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.475900 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.476121 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.476221 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.476428 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.476515 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.476736 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.476825 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.477043 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.477146 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.477349 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.477437 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.477654 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.477741 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.477961 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.478057 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.478278 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.478367 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.478585 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.478671 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.478907 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.479032 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.479213 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.479320 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.479519 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.479662 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.479793 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.479945 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.480104 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.480194 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.480426 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.480522 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.480750 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.480846 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.481071 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.481168 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.481327 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.481426 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.481579 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.481715 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.481902 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.482036 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.482224 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.482330 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.482533 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.482619 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.482842 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.482932 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.483149 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.483250 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.483457 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.483566 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.483811 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.483900 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.484118 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.484213 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.484418 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.484513 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.484723 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.484817 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.485038 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.485126 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.485345 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.485431 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.485651 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.485736 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.485955 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.486043 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.486254 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.486346 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.486558 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.486644 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.486862 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.486949 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.487163 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.487252 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.487468 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.487586 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.487796 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.487892 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.488100 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.488186 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.488404 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.488568 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.488706 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.488800 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.489012 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.489114 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.489328 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.489440 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.489644 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.489740 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.489951 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.490048 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.490254 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.490354 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.490556 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.490648 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.490816 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.490922 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.491118 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.491215 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.491425 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.491514 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.491767 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.491854 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.492072 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.492171 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.492376 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.492465 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.492678 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.492767 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.492979 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.493078 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.493285 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.493371 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.493588 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.493675 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.493893 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.493986 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.494191 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.494276 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.494493 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.494579 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.494801 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.494890 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.495104 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.495189 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.495407 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.495494 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.495734 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.495824 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.496036 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.496131 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.496337 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.496424 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.496638 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.496726 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.496937 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.497023 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.497237 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.497331 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.497534 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.497630 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.497848 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.497936 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.498154 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.498239 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.498460 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.498547 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.498764 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.498859 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.499074 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.499208 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.499907 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.500010 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.500235 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.500334 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.500545 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.500644 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.500854 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.500941 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.501174 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.501263 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.501478 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.501573 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.501787 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.501888 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.502105 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.502200 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.502415 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.502510 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.502720 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.502820 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.503025 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.503113 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.503329 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.503429 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.503657 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.503747 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.503965 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.504052 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.504271 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.504360 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.504576 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.504669 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.504878 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.504966 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.505197 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.505286 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.505511 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.505605 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.505820 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.505905 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.506128 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.506223 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.506436 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.506524 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.506755 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:29:40.506856 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.507073 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.507158 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.507382 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.507472 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.507746 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.507855 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.508071 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.508183 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.508391 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.508485 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.508713 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.508809 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.509031 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.509125 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.509342 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.509430 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.509650 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.509812 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.509959 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.510046 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.510280 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.510387 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.510597 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.510702 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.510903 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.511002 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.511220 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.511312 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.511531 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.511671 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.511861 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.511963 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.512168 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.512256 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.512478 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.512566 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.512788 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.512915 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.513099 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.513186 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.513417 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.513503 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.513729 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.513823 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.514038 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.514189 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.514348 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.514443 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.514656 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.514742 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.515008 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.515681 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.515848 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.515939 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.516155 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.516250 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.516462 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.516549 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.516769 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.516859 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.517080 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.517167 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.517384 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.517484 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.517703 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.517798 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.518027 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.518121 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.518332 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.518434 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.518662 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.518749 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.518967 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.519055 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.519275 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.519371 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.519604 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.519707 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.519914 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.520001 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.520219 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.520335 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.520534 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.520624 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.520841 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.520928 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.521147 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.521236 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.521460 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.521545 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.521769 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.521855 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.522073 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.522161 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.522382 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.522469 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.522686 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.522771 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.522991 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.523087 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.523298 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.523384 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.523628 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.523735 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.523941 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.524037 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.524248 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.524345 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.524559 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.524653 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.524881 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.524969 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.525190 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.525285 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.525500 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.525595 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.525821 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.525908 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.526134 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.526223 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.526437 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.526532 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.526747 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.526833 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.527056 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.527144 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.527370 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.527502 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.527696 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.527795 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.528006 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.528092 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.528312 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.528401 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.528617 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.528703 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.528920 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.529008 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.529229 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.529318 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.529533 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.529619 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.529837 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.529924 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.530140 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.530228 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.530448 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.530542 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.530775 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.530863 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.531090 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.531184 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.531396 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.531495 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.531724 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.531862 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.532028 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.532130 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.532330 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.532418 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.532671 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.532769 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.533032 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.533129 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.533297 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.533384 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.533625 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.533722 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.533942 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.534027 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.534258 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.534344 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.534566 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.534663 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.534878 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.534964 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.535184 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.535269 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.535492 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.535612 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.535823 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.535909 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.536133 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.536219 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.536436 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.536531 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.536746 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.536834 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.537055 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.537142 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.537362 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.537457 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.537665 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.537754 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.537982 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.538067 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.538291 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.538378 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.538594 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.538681 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.538899 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.539063 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.539206 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.539301 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.539563 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.539654 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.539879 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.539988 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.540202 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.540288 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.540516 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.540651 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.540829 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.540931 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.541138 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.541226 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.541449 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.541538 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.541756 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.541851 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.542066 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.542161 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.542379 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.542466 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.542687 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.542781 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.543000 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.543106 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.543307 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.543403 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.543648 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.543740 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.543959 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.544058 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.544274 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.544361 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.544577 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.544666 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.544889 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.544977 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.545209 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.545294 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.545519 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.545607 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.545833 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.545926 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.546143 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.546732 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.546987 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.547075 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.547299 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.547393 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.547632 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.547742 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.547947 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.548042 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.548252 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.548347 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.548557 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.548652 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.548865 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.548952 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.549176 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.549262 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.549485 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.549584 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.549794 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.549881 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.550098 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.550185 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.550409 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.550508 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.550717 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.550803 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.551021 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.551107 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.551327 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.551415 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.551658 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.551759 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.551969 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.552107 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.552277 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.552371 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.552596 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.552690 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.552914 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.553002 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.553219 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.553328 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.553526 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.553639 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.553843 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.553930 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.554150 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.554241 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.554456 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.554544 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.554761 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.554849 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.555063 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.555204 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.555370 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.555457 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.555703 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.555807 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.556018 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.556105 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.556327 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.556413 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.556641 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.556742 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.556947 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.557039 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.557257 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.557344 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.557565 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.557660 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.557871 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.557966 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.558183 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.558270 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.558491 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.558590 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.558799 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.558893 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.559108 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.559202 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.559414 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.559501 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.559746 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.559834 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.560053 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.560139 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.560361 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.560450 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.560666 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.560751 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.560981 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.561076 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.561285 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.561372 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.561584 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.561670 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.562421 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.562515 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.562742 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.562837 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.563107 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.563307 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.563418 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.563664 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.563763 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.563978 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.564066 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.564296 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.564392 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.564613 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.564703 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.564928 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.565024 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.565255 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.565343 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.565577 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.565665 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.565894 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.565982 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.566199 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.566298 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.566507 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.566667 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.566813 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.566902 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.567117 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.567205 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.567426 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.567525 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.567755 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.567850 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.568058 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.568154 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.568361 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.568449 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.568668 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.568755 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.568973 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.569060 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.569275 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.569368 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.569578 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.569665 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.569881 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.570140 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.570237 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.570476 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.570563 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.570787 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.570880 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.571092 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.571189 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.571412 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.571501 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.571745 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.571834 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.572048 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.572141 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.572352 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.572460 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.572653 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.572742 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.572991 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.573089 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.573296 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.573429 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.573605 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.573706 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.573916 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.574024 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.574227 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.574316 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.574535 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.574630 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.574843 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.574941 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.575151 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.575246 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.575451 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.575557 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.575778 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.575880 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.576080 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.576175 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.576386 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.576473 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.576689 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.576785 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.576989 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.577076 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.577296 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.577393 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.577628 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.577715 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.577934 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.578019 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.578491 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.578591 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.578794 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.578882 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.579103 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.579190 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.579404 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.579499 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.579742 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.579832 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.580052 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.580147 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.580354 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.580442 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.580655 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.580744 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.580968 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.581100 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.581273 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.581375 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.581574 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.581662 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.581879 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.581966 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.582181 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.582276 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.582493 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.582636 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.582794 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.582883 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.583093 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.583189 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.583393 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.583481 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.583726 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.583814 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.584030 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.584125 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.584331 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.584418 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.584641 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.584728 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.584952 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.585049 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.585253 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.585347 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.585555 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.585643 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.585860 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.585948 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.586161 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.586248 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.586464 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.586551 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.586769 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.586858 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.587072 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.587166 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.587379 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.587483 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.587703 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.587791 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.588010 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.588140 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.588311 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.588406 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.588615 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.588702 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.588916 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.589003 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.589219 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.589313 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.589520 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.589608 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.589820 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.589916 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.590126 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.590249 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.590427 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.590557 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.590742 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.591012 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.591176 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.591347 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.591500 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.591675 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.591820 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.591964 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.592127 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.592274 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.592427 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.592589 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.592733 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.592876 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.593100 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.593256 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.593401 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.593545 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.593687 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.593839 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.593996 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.594148 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.594293 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.594437 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.594590 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.594733 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.594888 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.595032 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.595175 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.595325 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.595469 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.595623 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.595710 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.595859 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.595980 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.596165 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.596292 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.596472 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.596605 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.596781 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.596910 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.597087 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.597213 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.597392 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.597534 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.597713 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.597846 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.598024 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.598154 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.598336 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.598474 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.598641 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.598795 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.598945 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.599118 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.599289 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.599421 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.599616 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.599756 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.599977 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.600078 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.600286 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.600374 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.600603 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.600704 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.600924 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.601028 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.601237 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.601324 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.601548 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.601633 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.601859 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.601956 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.602163 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.602249 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.602468 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.602577 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.602776 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.602899 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.603082 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.603214 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.603390 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.603687 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.603795 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.604001 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.604093 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.604329 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.604421 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.604640 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.604746 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.604944 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.605044 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.605254 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.605371 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.605556 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.605674 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.605880 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.606107 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.606199 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.606423 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.606524 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.606783 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.606882 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.607597 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.607692 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.607788 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.607876 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.607957 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.608045 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.608126 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.608213 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.608320 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.608403 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.608609 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.609215 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.609439 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.609541 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.609749 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.609839 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.610062 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.610186 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.610374 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.610498 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.610682 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.610809 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.611007 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.611102 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.611319 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.611416 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.611649 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.611753 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.611963 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.612061 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.612269 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.612366 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.612582 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.612670 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.612889 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.612980 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.613211 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.613313 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.613534 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.613622 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.613838 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.613925 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.614158 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.614255 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.614518 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.614615 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.614831 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.614919 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.615148 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.615236 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.615461 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.615574 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.615792 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.615933 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.616171 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.616259 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.616490 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.616576 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.616808 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.616903 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.617121 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.617216 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.617424 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.617510 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.617729 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.617814 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.618034 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.618121 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.618357 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.618451 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.618663 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.618758 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.618973 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.619058 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.619276 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.619371 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.619607 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.619710 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.619918 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.620005 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.620240 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.620334 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.620551 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.620651 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.620871 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.620972 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.621250 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.621343 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.621598 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.621686 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.621908 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.622053 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.622229 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.622325 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.622552 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.622640 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.622856 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.622945 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.623160 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.623248 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.623467 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.623604 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.623800 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.623890 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.624105 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.624192 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.624989 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.625083 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.625298 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.625386 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.625608 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.625732 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.625919 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.626047 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.626227 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.626316 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.626532 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.626618 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.626835 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.626922 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.627155 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.627243 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.627460 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.627573 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.627807 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.627908 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.628120 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.628215 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.628442 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.628537 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.628764 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.628865 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.629070 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.629157 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.629390 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.629478 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.629700 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.629796 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.630008 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.630096 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.630313 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.630404 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.630619 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.630714 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.630944 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.631032 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.631252 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.631346 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.631591 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.631684 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.631898 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.631987 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.632207 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.632298 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.632512 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.632601 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.632816 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.632904 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.633139 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.633234 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.633446 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.633536 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.633767 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.633879 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.634078 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.634176 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.634384 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.634476 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.634689 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.634777 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.635001 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.635096 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.635305 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.635398 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.635641 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.635730 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.635948 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.636053 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.636255 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.636343 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.636558 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.636643 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.636860 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.636959 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.637165 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.637252 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.637488 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.637575 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.637792 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.637880 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.638113 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.638200 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.638423 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.638511 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.638728 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.638816 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.639032 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.639122 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.639336 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.639423 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.639703 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.639796 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.640071 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.640158 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.640404 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.640502 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.640715 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.640805 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.641040 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.641127 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.641362 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.641458 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.641673 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.641761 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.641982 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.642076 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.642294 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.642391 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.642602 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.642691 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.642909 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.642997 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.643216 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.643321 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.643524 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.643668 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.643860 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.643949 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.644174 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.644282 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.644488 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.644575 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.644798 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.645015 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.645110 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.645344 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.645431 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.645658 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.645747 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.645974 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.646071 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.646289 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.646379 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.646601 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.646696 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.646915 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.647011 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.647226 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.647321 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.647557 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.647648 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.647874 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.648037 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.648186 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.648274 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.648500 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.648587 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.648820 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.648916 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.649142 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.649231 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.649453 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.649539 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.649770 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.649859 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.650081 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.650173 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.650397 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.650483 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.650711 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.650929 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.651064 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.651261 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.651383 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.651603 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.651716 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.651923 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.652022 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.652239 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.652378 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.652554 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.652651 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.652867 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.652954 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.653181 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.653270 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.653495 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.653585 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.653808 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.653895 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.654117 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.654213 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.654427 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.654516 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.654741 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.654828 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.655054 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.655151 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.655378 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.655466 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.655759 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.655854 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.656078 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.656170 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.656389 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.656476 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.656701 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.656788 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.657018 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.657106 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.657415 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.657535 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.657726 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.657848 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.658044 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.658180 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.658362 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.658504 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.658679 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.658827 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.658997 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.659141 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.659310 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.659457 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.659663 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.659807 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.659984 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.660113 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.660300 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.660417 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.660613 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.660710 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.660947 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.661053 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.661249 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.661341 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.661574 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.661672 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.661909 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.661997 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.662210 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.662296 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.662526 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.662617 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.662833 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.662920 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.663150 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.663368 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.663692 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.663785 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.664010 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.664110 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.664344 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.664432 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.664675 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.664772 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.664992 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.665086 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.665301 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.665401 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.665619 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.665706 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.665928 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.666051 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.666236 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.666333 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.666541 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.666628 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.666849 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.666937 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.667157 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.667257 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.667462 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.667577 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.667809 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.667896 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.668121 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.668221 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.668424 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.668510 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.668732 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.668820 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.669036 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.669124 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.669360 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.669569 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.669656 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.669919 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.670015 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.670238 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.670333 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.670546 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.670632 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.670850 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.670947 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.671666 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.671761 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.671995 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.672094 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.672300 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.672401 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.672612 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.672709 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.672917 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.673018 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.673225 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.673313 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.673530 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.673617 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.673837 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.673922 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.674138 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.674228 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.674446 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.674535 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.674750 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.674838 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.675053 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.675141 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.675361 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.675447 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.675695 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.675785 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.676026 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.676151 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.676336 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.676421 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.676642 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.676738 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.676947 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.677041 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.677256 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.677351 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.677559 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.677728 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.677867 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.677955 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.678174 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.678419 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.678514 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.678752 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.678840 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.679073 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.679167 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.679380 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.679466 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.679707 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.679811 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.680022 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.680109 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.680329 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.680431 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.680630 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.680716 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.680934 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.681028 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.681257 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.681352 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.681562 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.681649 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.681868 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.681956 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.682179 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.682275 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.682489 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.682576 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.682798 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.682885 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.683108 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.683204 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.683417 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.683506 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.683752 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.683840 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.684062 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.684141 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.684520 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.684622 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.684746 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.684935 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.685058 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.685259 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.685354 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.685595 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.685684 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.685927 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.686028 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.686237 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.686325 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.686548 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.686685 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.687395 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.687493 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.687756 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.687858 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.688073 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.688160 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.688386 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.688475 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.688695 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.688782 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.689006 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.689101 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.689315 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.689403 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.689626 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.689713 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.689940 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.690038 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.690243 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.690337 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.690550 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.690645 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.690860 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.690961 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.691172 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.691267 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.691485 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.691635 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.691822 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.691923 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.692135 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.692222 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.692452 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.692539 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.692792 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.692882 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.693109 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.693194 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.693419 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.693506 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.693735 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.693822 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.694055 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.694143 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.694368 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.694461 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.694682 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.694771 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.694984 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.695071 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.695287 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.695383 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.695622 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.695714 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.695933 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.696020 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.696248 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.696346 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.696553 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.696640 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.696855 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.696971 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.697158 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.697286 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.697464 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.697606 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.697767 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.697930 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.698070 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.698241 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.698372 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.698564 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.698674 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.698886 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.698983 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.699204 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.699293 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.699524 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.699630 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.699856 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.699961 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.700158 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.700252 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.700459 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.700547 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.700759 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.700861 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.701066 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.701153 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.701373 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.701460 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.701675 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.701773 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.701977 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.702065 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.702278 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.702375 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.702602 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.702692 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.702930 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.703017 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.703488 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.703600 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.703817 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.703907 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.704127 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.704215 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.704479 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.704574 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.704743 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.704839 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.705048 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.705137 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.705354 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.705450 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.705663 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.705752 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.705967 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.706061 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.706272 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.706368 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.706579 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.706669 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.706884 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.706971 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.707190 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.707349 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.707494 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.707601 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.707823 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.707922 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.708127 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.708224 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.708434 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.708559 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.708735 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.708822 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.709046 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.709142 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.709349 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.709443 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.709674 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.709766 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.709992 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.710081 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.710306 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.710392 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.710618 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.710704 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.710930 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.711017 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.711253 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.711341 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.711595 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.711687 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.711900 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.711990 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.712210 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.712299 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.712519 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.712616 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.712829 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.712916 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.713141 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.713226 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.713451 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.713547 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.713761 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.713847 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.714072 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.714160 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.714384 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.714517 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.714694 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.714792 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.715006 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.715095 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.715312 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.715400 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.715658 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.715759 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.715986 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.716074 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.716331 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.716463 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.716642 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.716730 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.716977 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.717064 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.717295 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.717392 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.717607 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.717700 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.717916 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.718028 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.718245 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.718333 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.718487 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 08:29:40.718582 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.718859 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.719179 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.719489 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.719837 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.720154 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.720467 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.720784 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.721101 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.721428 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.721753 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.722067 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.722394 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.722723 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.723071 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.723387 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.723756 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.724089 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.724409 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.724724 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.725031 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:29:40.725277 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 08:29:40.870566 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO dbcounter [None req-35a2fbaf-d8c6-4fb5-bcce-e1847034970c None None] Registered counter for database nova_api Aug 17 08:29:40.877951 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO dbcounter [None req-eadda1b9-4030-40fb-a5d9-90eb7351a083 None None] Registered counter for database nova_api Aug 17 08:29:40.890969 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_db.sqlalchemy.engines [None req-35a2fbaf-d8c6-4fb5-bcce-e1847034970c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 08:29:40.897074 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG oslo_db.sqlalchemy.engines [None req-eadda1b9-4030-40fb-a5d9-90eb7351a083 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 08:29:40.897478 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writer thread running {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 08:29:40.903480 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG dbcounter [-] [105762] Writer thread running {{(pid=105762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 08:29:40.953569 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.context [None req-35a2fbaf-d8c6-4fb5-bcce-e1847034970c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cf0f308f-a8b1-436d-b844-51a4a733ef03(cell1) {{(pid=105763) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 08:29:40.957503 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-35a2fbaf-d8c6-4fb5-bcce-e1847034970c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:29:40.957926 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-35a2fbaf-d8c6-4fb5-bcce-e1847034970c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:29:40.959488 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-35a2fbaf-d8c6-4fb5-bcce-e1847034970c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:29:40.959869 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.context [None req-eadda1b9-4030-40fb-a5d9-90eb7351a083 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cf0f308f-a8b1-436d-b844-51a4a733ef03(cell1) {{(pid=105762) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 08:29:40.960236 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-35a2fbaf-d8c6-4fb5-bcce-e1847034970c None None] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:29:40.960686 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-35a2fbaf-d8c6-4fb5-bcce-e1847034970c None None] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:29:40.962649 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-35a2fbaf-d8c6-4fb5-bcce-e1847034970c None None] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:29:40.963710 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG oslo_concurrency.lockutils [None req-eadda1b9-4030-40fb-a5d9-90eb7351a083 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:29:40.964189 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG oslo_concurrency.lockutils [None req-eadda1b9-4030-40fb-a5d9-90eb7351a083 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:29:40.964631 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO dbcounter [None req-35a2fbaf-d8c6-4fb5-bcce-e1847034970c None None] Registered counter for database nova_cell0 Aug 17 08:29:40.965753 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG oslo_concurrency.lockutils [None req-eadda1b9-4030-40fb-a5d9-90eb7351a083 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:29:40.966479 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG oslo_concurrency.lockutils [None req-eadda1b9-4030-40fb-a5d9-90eb7351a083 None None] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:29:40.966928 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG oslo_concurrency.lockutils [None req-eadda1b9-4030-40fb-a5d9-90eb7351a083 None None] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:29:40.969469 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG oslo_concurrency.lockutils [None req-eadda1b9-4030-40fb-a5d9-90eb7351a083 None None] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:29:40.970462 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO dbcounter [None req-35a2fbaf-d8c6-4fb5-bcce-e1847034970c None None] Registered counter for database nova_cell1 Aug 17 08:29:40.971441 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO dbcounter [None req-eadda1b9-4030-40fb-a5d9-90eb7351a083 None None] Registered counter for database nova_cell0 Aug 17 08:29:40.976933 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO dbcounter [None req-eadda1b9-4030-40fb-a5d9-90eb7351a083 None None] Registered counter for database nova_cell1 Aug 17 08:29:40.977630 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_db.sqlalchemy.engines [None req-35a2fbaf-d8c6-4fb5-bcce-e1847034970c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 08:29:40.979847 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_db.sqlalchemy.engines [None req-35a2fbaf-d8c6-4fb5-bcce-e1847034970c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 08:29:40.984870 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG oslo_db.sqlalchemy.engines [None req-eadda1b9-4030-40fb-a5d9-90eb7351a083 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 08:29:40.985478 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writer thread running {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 08:29:40.986160 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG oslo_db.sqlalchemy.engines [None req-eadda1b9-4030-40fb-a5d9-90eb7351a083 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 08:29:40.988198 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writer thread running {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 08:29:40.992979 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG dbcounter [-] [105762] Writer thread running {{(pid=105762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 08:29:40.994407 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG dbcounter [-] [105762] Writer thread running {{(pid=105762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 08:29:41.130157 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO dbcounter [None req-35a2fbaf-d8c6-4fb5-bcce-e1847034970c None None] Registered counter for database nova_cell0 Aug 17 08:29:41.137495 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO dbcounter [None req-eadda1b9-4030-40fb-a5d9-90eb7351a083 None None] Registered counter for database nova_cell0 Aug 17 08:29:41.138783 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_db.sqlalchemy.engines [None req-35a2fbaf-d8c6-4fb5-bcce-e1847034970c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 08:29:41.143141 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writer thread running {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 08:29:41.145903 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG oslo_db.sqlalchemy.engines [None req-eadda1b9-4030-40fb-a5d9-90eb7351a083 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 08:29:41.150082 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG dbcounter [-] [105762] Writer thread running {{(pid=105762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 08:29:41.479601 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: WARNING keystonemiddleware.auth_token [None req-eadda1b9-4030-40fb-a5d9-90eb7351a083 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 08:29:41.480634 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: WARNING keystonemiddleware.auth_token [None req-35a2fbaf-d8c6-4fb5-bcce-e1847034970c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 08:29:41.487601 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: WARNING keystonemiddleware.auth_token [None req-eadda1b9-4030-40fb-a5d9-90eb7351a083 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 08:29:41.487883 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: WARNING keystonemiddleware.auth_token [None req-35a2fbaf-d8c6-4fb5-bcce-e1847034970c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 08:29:41.825848 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: WARNING keystonemiddleware.auth_token [None req-eadda1b9-4030-40fb-a5d9-90eb7351a083 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 08:29:41.827454 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: WARNING keystonemiddleware.auth_token [None req-35a2fbaf-d8c6-4fb5-bcce-e1847034970c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 08:29:41.832031 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: WARNING keystonemiddleware.auth_token [None req-eadda1b9-4030-40fb-a5d9-90eb7351a083 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 08:29:41.833623 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: WARNING keystonemiddleware.auth_token [None req-35a2fbaf-d8c6-4fb5-bcce-e1847034970c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 08:29:41.837248 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55859a4689c0 pid: 105762 (default app) Aug 17 08:29:41.838841 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55859a4689c0 pid: 105763 (default app) Aug 17 08:29:41.839305 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-eadda1b9-4030-40fb-a5d9-90eb7351a083 None None] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:29:41.840492 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-eadda1b9-4030-40fb-a5d9-90eb7351a083 None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001729 Aug 17 08:29:41.840910 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Wed Aug 17 08:29:41 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:30:59.447275 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-35a2fbaf-d8c6-4fb5-bcce-e1847034970c None None] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:30:59.448567 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-35a2fbaf-d8c6-4fb5-bcce-e1847034970c None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002046 Aug 17 08:30:59.449255 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 08:30:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:30:59.461225 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG dbcounter [-] [105762] Writing DB stats nova_api:SELECT=3 {{(pid=105762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:59.462484 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG dbcounter [-] [105762] Writing DB stats nova_cell0:SELECT=3 {{(pid=105762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:59.463316 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG dbcounter [-] [105762] Writing DB stats nova_cell1:SELECT=3 {{(pid=105762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:30:59.464088 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG dbcounter [-] [105762] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:00.337058 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-39390800-def5-49e9-be27-b4e721613f1b admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:00.369926 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-39390800-def5-49e9-be27-b4e721613f1b admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.913804 Aug 17 08:31:00.371578 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 2/3] 10.222.0.15 () {60 vars in 1292 bytes} [Wed Aug 17 08:30:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:31:02.726617 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-35a2fbaf-d8c6-4fb5-bcce-e1847034970c None None] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:02.727948 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-35a2fbaf-d8c6-4fb5-bcce-e1847034970c None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001704 Aug 17 08:31:02.728487 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 2/4] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 08:31:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:31:03.183171 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-f40ff682-d1f1-4bc8-af57-e03c80880c33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "vcpus": 1, "rxtx_factor": 1.0, "ram": 256}} {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:31:03.204913 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 08:31:03.204913 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: warnings.warn(msg) Aug 17 08:31:03.233655 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-f40ff682-d1f1-4bc8-af57-e03c80880c33 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.498759 Aug 17 08:31:03.234577 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 3/5] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 08:31:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 08:31:03.248803 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writing DB stats nova_api:SELECT=3 {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:03.250212 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writing DB stats nova_cell0:SELECT=3 {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:03.251166 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writing DB stats nova_cell1:SELECT=3 {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:03.252273 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:03.459018 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-3a0f9381-2861-4a80-9edc-1899524ca9aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:31:03.463914 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 08:31:03.463914 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: warnings.warn(msg) Aug 17 08:31:03.523685 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-3a0f9381-2861-4a80-9edc-1899524ca9aa admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.280896 Aug 17 08:31:03.524274 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 3/6] 10.222.0.15 () {64 vars in 1336 bytes} [Wed Aug 17 08:31:03 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:31:05.866859 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-f40ff682-d1f1-4bc8-af57-e03c80880c33 admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:05.867921 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-f40ff682-d1f1-4bc8-af57-e03c80880c33 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 17 08:31:05.868326 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 4/7] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 08:31:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:31:06.549656 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-8c2aabe1-7a1e-447d-a768-850394fe6afb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "vcpus": 1, "name": "ds512M", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 5, "ram": 512}} {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:31:06.568444 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 08:31:06.568444 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: warnings.warn(msg) Aug 17 08:31:06.593441 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-8c2aabe1-7a1e-447d-a768-850394fe6afb admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.714719 Aug 17 08:31:06.598036 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 4/8] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 08:31:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 08:31:06.604567 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-68b2f034-ed5f-4225-b3f9-074543e24021 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:31:06.610227 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 08:31:06.610227 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: warnings.warn(msg) Aug 17 08:31:06.645615 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-68b2f034-ed5f-4225-b3f9-074543e24021 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045907 Aug 17 08:31:06.646826 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 5/9] 10.222.0.15 () {64 vars in 1336 bytes} [Wed Aug 17 08:31:06 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:31:08.972720 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-8c2aabe1-7a1e-447d-a768-850394fe6afb admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:08.973642 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-8c2aabe1-7a1e-447d-a768-850394fe6afb admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 17 08:31:08.974050 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 08:31:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:31:09.376782 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-cd9e65a5-b1d9-4989-8e39-c53c582448a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "rxtx_factor": 1.0, "disk": 10, "swap": 0, "vcpus": 1, "ram": 1024, "id": "d2", "os-flavor-access:is_public": true}} {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:31:09.395748 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-cd9e65a5-b1d9-4989-8e39-c53c582448a6 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.415515 Aug 17 08:31:09.396487 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 6/11] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 08:31:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 08:31:09.408857 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-d902bfee-7bd8-47e6-a66b-ccae20e3d1c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:31:09.432102 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-d902bfee-7bd8-47e6-a66b-ccae20e3d1c7 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026920 Aug 17 08:31:09.432668 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 6/12] 10.222.0.15 () {64 vars in 1336 bytes} [Wed Aug 17 08:31:09 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:31:11.774548 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-cd9e65a5-b1d9-4989-8e39-c53c582448a6 admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:11.776342 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-cd9e65a5-b1d9-4989-8e39-c53c582448a6 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002253 Aug 17 08:31:11.776825 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 7/13] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 08:31:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:31:12.232083 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-fc37e3e3-413d-4dec-9ba7-631aabd8c338 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "id": "d3", "disk": 10, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:31:12.250886 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-fc37e3e3-413d-4dec-9ba7-631aabd8c338 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.467584 Aug 17 08:31:12.251729 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 7/14] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 08:31:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 08:31:12.264519 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-2a28e3a8-4f7f-4ac5-9000-4f2179ee3266 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:31:12.289857 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-2a28e3a8-4f7f-4ac5-9000-4f2179ee3266 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029347 Aug 17 08:31:12.303571 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 8/15] 10.222.0.15 () {64 vars in 1336 bytes} [Wed Aug 17 08:31:12 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:31:14.613858 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-fc37e3e3-413d-4dec-9ba7-631aabd8c338 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:14.614875 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-fc37e3e3-413d-4dec-9ba7-631aabd8c338 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 17 08:31:14.615259 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 8/16] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 08:31:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:31:15.057530 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-b27355e3-0c99-46bd-a834-485ffa16666b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 4096, "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "name": "ds4G", "id": "d4", "rxtx_factor": 1.0}} {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:31:15.077838 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-b27355e3-0c99-46bd-a834-485ffa16666b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.455713 Aug 17 08:31:15.078491 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 9/17] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 08:31:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 08:31:15.090449 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-811522e6-de8d-437b-be15-e21adf6ebec2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:31:15.120698 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-811522e6-de8d-437b-be15-e21adf6ebec2 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033813 Aug 17 08:31:15.133791 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 9/18] 10.222.0.15 () {64 vars in 1336 bytes} [Wed Aug 17 08:31:15 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:31:18.080434 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-b27355e3-0c99-46bd-a834-485ffa16666b admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:18.081466 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-b27355e3-0c99-46bd-a834-485ffa16666b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Aug 17 08:31:18.081886 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 10/19] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 08:31:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:31:18.494687 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-5371bacc-f584-4c06-9fa7-e8c0441a3ea9 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:18.520183 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-5371bacc-f584-4c06-9fa7-e8c0441a3ea9 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.431328 Aug 17 08:31:18.520734 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 10/20] 10.222.0.15 () {60 vars in 1292 bytes} [Wed Aug 17 08:31:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 08:31:20.890854 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-b27355e3-0c99-46bd-a834-485ffa16666b admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:20.891926 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-b27355e3-0c99-46bd-a834-485ffa16666b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 17 08:31:20.892331 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 11/21] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 08:31:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:31:21.350783 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-137284ba-356c-4fe6-a3c8-aa8baef7b19a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "id": "1", "swap": 0, "ram": 512}} {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:31:21.371453 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-137284ba-356c-4fe6-a3c8-aa8baef7b19a admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.472814 Aug 17 08:31:21.371975 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 11/22] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 08:31:20 2022] POST /compute/v2.1/flavors => generated 402 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 08:31:21.384387 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-fc93fff9-bd24-4245-9197-e9db2bcc0626 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:31:21.409353 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-fc93fff9-bd24-4245-9197-e9db2bcc0626 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028612 Aug 17 08:31:21.410133 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 12/23] 10.222.0.15 () {64 vars in 1333 bytes} [Wed Aug 17 08:31:21 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:31:23.858611 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-137284ba-356c-4fe6-a3c8-aa8baef7b19a admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:23.859645 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-137284ba-356c-4fe6-a3c8-aa8baef7b19a admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 17 08:31:23.860051 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 12/24] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 08:31:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:31:24.251727 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-c5ceab1f-fc7a-4c9e-a995-02631451e44e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 20, "id": "2", "name": "m1.small"}} {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:31:24.270409 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-c5ceab1f-fc7a-4c9e-a995-02631451e44e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.404320 Aug 17 08:31:24.271019 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 13/25] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 08:31:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 08:31:24.282804 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-7de651e9-268f-4a12-99e2-e5034d6fb01e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:31:24.307361 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-7de651e9-268f-4a12-99e2-e5034d6fb01e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028140 Aug 17 08:31:24.308042 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 13/26] 10.222.0.15 () {64 vars in 1333 bytes} [Wed Aug 17 08:31:24 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:31:26.667508 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-c5ceab1f-fc7a-4c9e-a995-02631451e44e admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:26.668571 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-c5ceab1f-fc7a-4c9e-a995-02631451e44e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 17 08:31:26.669241 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 14/27] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 08:31:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:31:27.100792 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-a522c6a6-12c0-42f7-9516-f1704fde4700 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "3", "rxtx_factor": 1.0, "disk": 40, "ram": 4096, "name": "m1.medium", "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:31:27.121105 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-a522c6a6-12c0-42f7-9516-f1704fde4700 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.445818 Aug 17 08:31:27.121745 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 14/28] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 08:31:26 2022] POST /compute/v2.1/flavors => generated 406 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 08:31:27.134555 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-ce60333c-7b6f-4be3-995a-6b240c5fe709 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:31:27.165234 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-ce60333c-7b6f-4be3-995a-6b240c5fe709 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035056 Aug 17 08:31:27.165858 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 15/29] 10.222.0.15 () {64 vars in 1333 bytes} [Wed Aug 17 08:31:27 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:31:29.591973 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-a522c6a6-12c0-42f7-9516-f1704fde4700 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:29.593786 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-a522c6a6-12c0-42f7-9516-f1704fde4700 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002267 Aug 17 08:31:29.594452 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 15/30] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 08:31:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:31:30.048468 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-0d9564f0-dee8-43c1-a6b2-9dbc4fd61420 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "4", "disk": 80, "swap": 0, "ram": 8192}} {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:31:30.053951 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG dbcounter [-] [105762] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:30.068902 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-0d9564f0-dee8-43c1-a6b2-9dbc4fd61420 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.468049 Aug 17 08:31:30.071670 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 16/31] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 08:31:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 08:31:30.082126 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-12984432-0a57-4b8f-b661-5e0fef822500 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:31:30.107023 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-12984432-0a57-4b8f-b661-5e0fef822500 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028427 Aug 17 08:31:30.107640 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 16/32] 10.222.0.15 () {64 vars in 1333 bytes} [Wed Aug 17 08:31:30 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:31:32.456533 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-0d9564f0-dee8-43c1-a6b2-9dbc4fd61420 admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:32.457540 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-0d9564f0-dee8-43c1-a6b2-9dbc4fd61420 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 17 08:31:32.459940 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 17/33] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 08:31:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:31:32.897017 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-37334eee-e190-413b-a1d7-8d6fd2b62814 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "os-flavor-access:is_public": true, "ram": 16384, "disk": 160, "swap": 0, "rxtx_factor": 1.0, "vcpus": 8}} {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:31:32.918220 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-37334eee-e190-413b-a1d7-8d6fd2b62814 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.454375 Aug 17 08:31:32.918943 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 17/34] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 08:31:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 08:31:32.931059 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-cd0eab95-200d-4e13-a09e-cef06f4214df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:31:32.963331 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-cd0eab95-200d-4e13-a09e-cef06f4214df admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036089 Aug 17 08:31:32.964373 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 18/35] 10.222.0.15 () {64 vars in 1333 bytes} [Wed Aug 17 08:31:32 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:31:50.752943 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-37334eee-e190-413b-a1d7-8d6fd2b62814 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:50.753963 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-37334eee-e190-413b-a1d7-8d6fd2b62814 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 17 08:31:50.754366 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 18/36] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 08:31:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:31:50.765471 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG dbcounter [-] [105762] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:51.142196 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-d6356507-31c7-4551-871c-de37c32617a8 admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:51.160580 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-d6356507-31c7-4551-871c-de37c32617a8 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399547 Aug 17 08:31:51.161114 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 19/37] 10.222.0.15 () {60 vars in 1292 bytes} [Wed Aug 17 08:31:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:31:52.203514 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-37334eee-e190-413b-a1d7-8d6fd2b62814 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:52.204574 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-37334eee-e190-413b-a1d7-8d6fd2b62814 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 17 08:31:52.204977 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 19/38] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 08:31:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:31:52.723926 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-ba1f117f-a4f5-4273-ab4b-ff0120bafaf6 admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:52.729961 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.wsgi [None req-ba1f117f-a4f5-4273-ab4b-ff0120bafaf6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 17 08:31:52.733255 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-ba1f117f-a4f5-4273-ab4b-ff0120bafaf6 admin admin] Request method failure captured: Aug 17 08:31:52.733255 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 17 08:31:52.733255 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: Accept: application/json Aug 17 08:31:52.733255 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: Accept-Encoding: gzip, deflate Aug 17 08:31:52.733255 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: Connection: keep-alive Aug 17 08:31:52.733255 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: Content-Length: 0 Aug 17 08:31:52.733255 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: Host: 10.222.0.15 Aug 17 08:31:52.733255 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: Openstack-Api-Version: compute 2.90 Aug 17 08:31:52.733255 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: Openstack-System-Scope: None Aug 17 08:31:52.733255 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: User-Agent: python-novaclient Aug 17 08:31:52.733255 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Auth-Token: gAAAAABi_Kd46hibq9Nxdj7Eon9aN3MoW5e2xi7gEltBO-xu-fORjImfyj7BRAOteS3K6Sumd-yp7ybRBPZctmKkGF6huC1cIZN55X_9hTPt7qrrRIhjVNmb808NmRkCaKH-aF3jWDkhMy8ZDDvDU1eBo9bpIDi2U6zMXnbRsfnvQhhF-YjCPjw Aug 17 08:31:52.733255 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Domain-Id: None Aug 17 08:31:52.733255 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Domain-Name: None Aug 17 08:31:52.733255 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Identity-Status: Confirmed Aug 17 08:31:52.733255 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Is-Admin-Project: True Aug 17 08:31:52.733255 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 08:31:52.733255 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Project-Domain-Id: default Aug 17 08:31:52.733255 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Project-Domain-Name: Default Aug 17 08:31:52.733255 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Project-Id: 0453a8b2bb634303b77e24e668baded5 Aug 17 08:31:52.733255 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Project-Name: admin Aug 17 08:31:52.733255 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Role: admin,member,reader Aug 17 08:31:52.733255 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Roles: admin,member,reader Aug 17 08:31:52.734913 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0453a8b2bb634303b77e24e668baded5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0453a8b2bb634303b77e24e668baded5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0453a8b2bb634303b77e24e668baded5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0453a8b2bb634303b77e24e668baded5", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:31:52.734913 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Tenant: admin Aug 17 08:31:52.734913 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Tenant-Id: 0453a8b2bb634303b77e24e668baded5 Aug 17 08:31:52.734913 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Tenant-Name: admin Aug 17 08:31:52.734913 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-User: admin Aug 17 08:31:52.734913 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-User-Domain-Id: default Aug 17 08:31:52.734913 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-User-Domain-Name: Default Aug 17 08:31:52.734913 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-User-Id: 0f93f4121d434aed821124eb6820eb0b Aug 17 08:31:52.734913 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-User-Name: admin Aug 17 08:31:52.734913 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: method: > Aug 17 08:31:52.734913 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: exception: Flavor 42 could not be found. Aug 17 08:31:52.734913 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: action_args: {'id': '42'} Aug 17 08:31:52.734913 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:31:52.734913 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:31:52.736018 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 08:31:52.736018 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 08:31:52.736018 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 08:31:52.736018 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 08:31:52.736018 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 08:31:52.736018 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 08:31:52.736018 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 08:31:52.736018 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 08:31:52.736018 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 08:31:52.736018 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:31:52.736018 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 08:31:52.736018 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 08:31:52.736018 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 17 08:31:52.736018 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi Aug 17 08:31:52.736018 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:31:52.736018 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi Aug 17 08:31:52.736018 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:31:52.736018 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:31:52.736018 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:31:52.737606 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:31:52.737606 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:31:52.737606 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:31:52.737606 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:31:52.737606 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 08:31:52.737606 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:31:52.737606 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 17 08:31:52.737606 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi Aug 17 08:31:52.737606 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:31:52.737606 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi Aug 17 08:31:52.737606 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:31:52.737606 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:31:52.737606 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:31:52.737606 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:31:52.737606 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:31:52.737606 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 17 08:31:52.737606 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi Aug 17 08:31:52.737606 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-ba1f117f-a4f5-4273-ab4b-ff0120bafaf6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:31:52.739007 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-ba1f117f-a4f5-4273-ab4b-ff0120bafaf6 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.392290 Aug 17 08:31:52.739007 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 20/39] 10.222.0.15 () {60 vars in 1190 bytes} [Wed Aug 17 08:31:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 08:31:52.744918 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-f9ee72d1-95b9-42ef-9ef3-c90e548227a0 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:52.749144 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:31:52.768518 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-f9ee72d1-95b9-42ef-9ef3-c90e548227a0 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027766 Aug 17 08:31:52.769074 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 20/40] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Aug 17 08:31:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:31:52.778859 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-eb011b42-0d12-4692-aebe-68499f07841e admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:52.802601 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-eb011b42-0d12-4692-aebe-68499f07841e admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027336 Aug 17 08:31:52.803134 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 21/41] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Aug 17 08:31:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:31:52.812936 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-e25004f8-e124-4198-810c-e5eeef6175e4 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:52.819154 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.wsgi [None req-e25004f8-e124-4198-810c-e5eeef6175e4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 17 08:31:52.823811 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-e25004f8-e124-4198-810c-e5eeef6175e4 admin admin] Request method failure captured: Aug 17 08:31:52.823811 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 17 08:31:52.823811 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: Accept: application/json Aug 17 08:31:52.823811 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: Accept-Encoding: gzip, deflate Aug 17 08:31:52.823811 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: Connection: keep-alive Aug 17 08:31:52.823811 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: Content-Length: 0 Aug 17 08:31:52.823811 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: Host: 10.222.0.15 Aug 17 08:31:52.823811 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: Openstack-Api-Version: compute 2.90 Aug 17 08:31:52.823811 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: Openstack-System-Scope: None Aug 17 08:31:52.823811 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: User-Agent: python-novaclient Aug 17 08:31:52.823811 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Auth-Token: gAAAAABi_Kd46hibq9Nxdj7Eon9aN3MoW5e2xi7gEltBO-xu-fORjImfyj7BRAOteS3K6Sumd-yp7ybRBPZctmKkGF6huC1cIZN55X_9hTPt7qrrRIhjVNmb808NmRkCaKH-aF3jWDkhMy8ZDDvDU1eBo9bpIDi2U6zMXnbRsfnvQhhF-YjCPjw Aug 17 08:31:52.823811 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Domain-Id: None Aug 17 08:31:52.823811 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Domain-Name: None Aug 17 08:31:52.823811 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Identity-Status: Confirmed Aug 17 08:31:52.823811 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Is-Admin-Project: True Aug 17 08:31:52.823811 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 08:31:52.823811 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Project-Domain-Id: default Aug 17 08:31:52.823811 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Project-Domain-Name: Default Aug 17 08:31:52.823811 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Project-Id: 0453a8b2bb634303b77e24e668baded5 Aug 17 08:31:52.823811 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Project-Name: admin Aug 17 08:31:52.823811 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Role: admin,member,reader Aug 17 08:31:52.823811 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Roles: admin,member,reader Aug 17 08:31:52.825472 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0453a8b2bb634303b77e24e668baded5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0453a8b2bb634303b77e24e668baded5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0453a8b2bb634303b77e24e668baded5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0453a8b2bb634303b77e24e668baded5", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:31:52.825472 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Tenant: admin Aug 17 08:31:52.825472 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Tenant-Id: 0453a8b2bb634303b77e24e668baded5 Aug 17 08:31:52.825472 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Tenant-Name: admin Aug 17 08:31:52.825472 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-User: admin Aug 17 08:31:52.825472 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-User-Domain-Id: default Aug 17 08:31:52.825472 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-User-Domain-Name: Default Aug 17 08:31:52.825472 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-User-Id: 0f93f4121d434aed821124eb6820eb0b Aug 17 08:31:52.825472 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-User-Name: admin Aug 17 08:31:52.825472 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: method: > Aug 17 08:31:52.825472 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: exception: Flavor 42 could not be found. Aug 17 08:31:52.825472 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: action_args: {'id': '42'} Aug 17 08:31:52.825472 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:31:52.825472 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:31:52.826435 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 08:31:52.826435 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 08:31:52.826435 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 08:31:52.826435 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 08:31:52.826435 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 08:31:52.826435 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 08:31:52.826435 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 08:31:52.826435 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 08:31:52.826435 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 08:31:52.826435 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:31:52.826435 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 08:31:52.826435 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 08:31:52.826435 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 17 08:31:52.826435 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Aug 17 08:31:52.826435 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:31:52.826435 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Aug 17 08:31:52.826435 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:31:52.826435 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:31:52.826435 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:31:52.827489 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:31:52.827489 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:31:52.827489 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:31:52.827489 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:31:52.827489 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 08:31:52.827489 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:31:52.827489 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 17 08:31:52.827489 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Aug 17 08:31:52.827489 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:31:52.827489 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Aug 17 08:31:52.827489 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:31:52.827489 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:31:52.827489 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:31:52.827489 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:31:52.827489 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:31:52.827489 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 17 08:31:52.827489 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Aug 17 08:31:52.827489 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-e25004f8-e124-4198-810c-e5eeef6175e4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:31:52.828565 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-e25004f8-e124-4198-810c-e5eeef6175e4 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015913 Aug 17 08:31:52.828565 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 21/42] 10.222.0.15 () {60 vars in 1190 bytes} [Wed Aug 17 08:31:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 08:31:53.781382 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-eb011b42-0d12-4692-aebe-68499f07841e admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:53.782380 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-eb011b42-0d12-4692-aebe-68499f07841e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 17 08:31:53.782794 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 22/43] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 08:31:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:31:54.303816 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-a087a3bc-66b1-4fd3-af0a-cb353941d648 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:54.309112 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.wsgi [None req-a087a3bc-66b1-4fd3-af0a-cb353941d648 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 17 08:31:54.310607 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-a087a3bc-66b1-4fd3-af0a-cb353941d648 admin admin] Request method failure captured: Aug 17 08:31:54.310607 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 17 08:31:54.310607 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: Accept: application/json Aug 17 08:31:54.310607 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: Accept-Encoding: gzip, deflate Aug 17 08:31:54.310607 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: Connection: keep-alive Aug 17 08:31:54.310607 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: Content-Length: 0 Aug 17 08:31:54.310607 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: Host: 10.222.0.15 Aug 17 08:31:54.310607 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: Openstack-Api-Version: compute 2.90 Aug 17 08:31:54.310607 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: Openstack-System-Scope: None Aug 17 08:31:54.310607 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: User-Agent: python-novaclient Aug 17 08:31:54.310607 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Auth-Token: gAAAAABi_Kd5dbbEHQEUwVqkhuuCdpHDijkeQNROLi4soS-BdhhxrWFTdJECBFRGgjCbyuy43xXMoC_YifXUPU6p6LwGnnb2WoE9ppOPNW09UnK2ai9HlDAo__MmNLIRghAbmWpmb7N1YulG4CITaMGCFDOxGq_F3v1dJ0n69Bp2fXA_wo4ADsY Aug 17 08:31:54.310607 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Domain-Id: None Aug 17 08:31:54.310607 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Domain-Name: None Aug 17 08:31:54.310607 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Identity-Status: Confirmed Aug 17 08:31:54.310607 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Is-Admin-Project: True Aug 17 08:31:54.310607 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 08:31:54.310607 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Project-Domain-Id: default Aug 17 08:31:54.310607 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Project-Domain-Name: Default Aug 17 08:31:54.310607 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Project-Id: 0453a8b2bb634303b77e24e668baded5 Aug 17 08:31:54.310607 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Project-Name: admin Aug 17 08:31:54.310607 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Role: admin,member,reader Aug 17 08:31:54.310607 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Roles: admin,member,reader Aug 17 08:31:54.311996 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0453a8b2bb634303b77e24e668baded5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0453a8b2bb634303b77e24e668baded5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0453a8b2bb634303b77e24e668baded5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0453a8b2bb634303b77e24e668baded5", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:31:54.311996 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Tenant: admin Aug 17 08:31:54.311996 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Tenant-Id: 0453a8b2bb634303b77e24e668baded5 Aug 17 08:31:54.311996 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Tenant-Name: admin Aug 17 08:31:54.311996 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-User: admin Aug 17 08:31:54.311996 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-User-Domain-Id: default Aug 17 08:31:54.311996 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-User-Domain-Name: Default Aug 17 08:31:54.311996 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-User-Id: 0f93f4121d434aed821124eb6820eb0b Aug 17 08:31:54.311996 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-User-Name: admin Aug 17 08:31:54.311996 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: method: > Aug 17 08:31:54.311996 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: exception: Flavor 84 could not be found. Aug 17 08:31:54.311996 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: action_args: {'id': '84'} Aug 17 08:31:54.311996 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:31:54.311996 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:31:54.312929 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 08:31:54.312929 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 08:31:54.312929 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 08:31:54.312929 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 08:31:54.312929 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 08:31:54.312929 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 08:31:54.312929 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 08:31:54.312929 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 08:31:54.312929 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 08:31:54.312929 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:31:54.312929 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 08:31:54.312929 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 08:31:54.312929 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 17 08:31:54.312929 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Aug 17 08:31:54.312929 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:31:54.312929 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Aug 17 08:31:54.312929 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:31:54.312929 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:31:54.312929 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:31:54.314268 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:31:54.314268 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:31:54.314268 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:31:54.314268 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:31:54.314268 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 08:31:54.314268 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:31:54.314268 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 17 08:31:54.314268 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Aug 17 08:31:54.314268 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:31:54.314268 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Aug 17 08:31:54.314268 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:31:54.314268 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:31:54.314268 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:31:54.314268 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:31:54.314268 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:31:54.314268 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 17 08:31:54.314268 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Aug 17 08:31:54.314268 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-a087a3bc-66b1-4fd3-af0a-cb353941d648 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:31:54.315602 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-a087a3bc-66b1-4fd3-af0a-cb353941d648 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.393173 Aug 17 08:31:54.315602 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 22/44] 10.222.0.15 () {60 vars in 1190 bytes} [Wed Aug 17 08:31:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 08:31:54.322220 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-b3569165-5e1d-44a7-8374-d0267745fd48 admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:54.337790 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-b3569165-5e1d-44a7-8374-d0267745fd48 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019693 Aug 17 08:31:54.338314 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 23/45] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Aug 17 08:31:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:31:54.347395 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-3c0f19ec-cb14-4107-b62d-b64b8377cd4d admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:54.362056 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-3c0f19ec-cb14-4107-b62d-b64b8377cd4d admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018079 Aug 17 08:31:54.362575 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 23/46] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Aug 17 08:31:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:31:54.371710 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-c2be01fd-b59f-405a-91fd-04be78f9a4d0 admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:54.377009 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.wsgi [None req-c2be01fd-b59f-405a-91fd-04be78f9a4d0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 17 08:31:54.378542 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-c2be01fd-b59f-405a-91fd-04be78f9a4d0 admin admin] Request method failure captured: Aug 17 08:31:54.378542 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 17 08:31:54.378542 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: Accept: application/json Aug 17 08:31:54.378542 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: Accept-Encoding: gzip, deflate Aug 17 08:31:54.378542 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: Connection: keep-alive Aug 17 08:31:54.378542 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: Content-Length: 0 Aug 17 08:31:54.378542 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: Host: 10.222.0.15 Aug 17 08:31:54.378542 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: Openstack-Api-Version: compute 2.90 Aug 17 08:31:54.378542 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: Openstack-System-Scope: None Aug 17 08:31:54.378542 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: User-Agent: python-novaclient Aug 17 08:31:54.378542 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Auth-Token: gAAAAABi_Kd5dbbEHQEUwVqkhuuCdpHDijkeQNROLi4soS-BdhhxrWFTdJECBFRGgjCbyuy43xXMoC_YifXUPU6p6LwGnnb2WoE9ppOPNW09UnK2ai9HlDAo__MmNLIRghAbmWpmb7N1YulG4CITaMGCFDOxGq_F3v1dJ0n69Bp2fXA_wo4ADsY Aug 17 08:31:54.378542 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Domain-Id: None Aug 17 08:31:54.378542 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Domain-Name: None Aug 17 08:31:54.378542 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Identity-Status: Confirmed Aug 17 08:31:54.378542 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Is-Admin-Project: True Aug 17 08:31:54.378542 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 08:31:54.378542 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Project-Domain-Id: default Aug 17 08:31:54.378542 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Project-Domain-Name: Default Aug 17 08:31:54.378542 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Project-Id: 0453a8b2bb634303b77e24e668baded5 Aug 17 08:31:54.378542 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Project-Name: admin Aug 17 08:31:54.378542 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Role: admin,member,reader Aug 17 08:31:54.378542 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Roles: admin,member,reader Aug 17 08:31:54.380126 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0453a8b2bb634303b77e24e668baded5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0453a8b2bb634303b77e24e668baded5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0453a8b2bb634303b77e24e668baded5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0453a8b2bb634303b77e24e668baded5", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:31:54.380126 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Tenant: admin Aug 17 08:31:54.380126 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Tenant-Id: 0453a8b2bb634303b77e24e668baded5 Aug 17 08:31:54.380126 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Tenant-Name: admin Aug 17 08:31:54.380126 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-User: admin Aug 17 08:31:54.380126 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-User-Domain-Id: default Aug 17 08:31:54.380126 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-User-Domain-Name: Default Aug 17 08:31:54.380126 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-User-Id: 0f93f4121d434aed821124eb6820eb0b Aug 17 08:31:54.380126 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-User-Name: admin Aug 17 08:31:54.380126 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: method: > Aug 17 08:31:54.380126 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: exception: Flavor 84 could not be found. Aug 17 08:31:54.380126 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: action_args: {'id': '84'} Aug 17 08:31:54.380126 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:31:54.380126 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:31:54.381103 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 08:31:54.381103 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 08:31:54.381103 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 08:31:54.381103 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 08:31:54.381103 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 08:31:54.381103 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 08:31:54.381103 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 08:31:54.381103 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 08:31:54.381103 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 08:31:54.381103 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:31:54.381103 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 08:31:54.381103 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 08:31:54.381103 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 17 08:31:54.381103 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi Aug 17 08:31:54.381103 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:31:54.381103 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi Aug 17 08:31:54.381103 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:31:54.381103 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:31:54.381103 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:31:54.382702 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:31:54.382702 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:31:54.382702 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:31:54.382702 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:31:54.382702 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 08:31:54.382702 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:31:54.382702 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 17 08:31:54.382702 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi Aug 17 08:31:54.382702 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:31:54.382702 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi Aug 17 08:31:54.382702 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:31:54.382702 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:31:54.382702 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:31:54.382702 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:31:54.382702 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:31:54.382702 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 17 08:31:54.382702 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi Aug 17 08:31:54.382702 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-c2be01fd-b59f-405a-91fd-04be78f9a4d0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:31:54.383789 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-c2be01fd-b59f-405a-91fd-04be78f9a4d0 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011674 Aug 17 08:31:54.383789 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 24/47] 10.222.0.15 () {60 vars in 1190 bytes} [Wed Aug 17 08:31:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 17 08:31:55.336332 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-3c0f19ec-cb14-4107-b62d-b64b8377cd4d admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:55.337340 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-3c0f19ec-cb14-4107-b62d-b64b8377cd4d admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 17 08:31:55.337988 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 24/48] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 08:31:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:31:55.856573 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-f9e2f3db-6d59-4a08-b388-361c41109d16 admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:55.862295 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.wsgi [None req-f9e2f3db-6d59-4a08-b388-361c41109d16 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 17 08:31:55.863843 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-f9e2f3db-6d59-4a08-b388-361c41109d16 admin admin] Request method failure captured: Aug 17 08:31:55.863843 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 17 08:31:55.863843 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: Accept: application/json Aug 17 08:31:55.863843 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: Accept-Encoding: gzip, deflate Aug 17 08:31:55.863843 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: Connection: keep-alive Aug 17 08:31:55.863843 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: Content-Length: 0 Aug 17 08:31:55.863843 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: Host: 10.222.0.15 Aug 17 08:31:55.863843 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: Openstack-Api-Version: compute 2.90 Aug 17 08:31:55.863843 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: Openstack-System-Scope: None Aug 17 08:31:55.863843 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: User-Agent: python-novaclient Aug 17 08:31:55.863843 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Auth-Token: gAAAAABi_Kd7DUajTN9dTENGVRg38mgFZnI9IAs97sX4hddJ2v-LHHOAOtLV-0BaMmKrnxUDnVRsF2xDj4pxvVjv1vzVZQkfpg7qXhMyUx2ma2Blax3MTluukLRhZ3L7u5ND3vebkYzc1u0uh-w3HbZUX72jANBzhkCL-bJNt9auny0h8GWHTrk Aug 17 08:31:55.863843 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Domain-Id: None Aug 17 08:31:55.863843 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Domain-Name: None Aug 17 08:31:55.863843 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Identity-Status: Confirmed Aug 17 08:31:55.863843 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Is-Admin-Project: True Aug 17 08:31:55.863843 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 08:31:55.863843 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Project-Domain-Id: default Aug 17 08:31:55.863843 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Project-Domain-Name: Default Aug 17 08:31:55.863843 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Project-Id: 0453a8b2bb634303b77e24e668baded5 Aug 17 08:31:55.863843 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Project-Name: admin Aug 17 08:31:55.863843 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Role: admin,member,reader Aug 17 08:31:55.863843 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Roles: admin,member,reader Aug 17 08:31:55.865487 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0453a8b2bb634303b77e24e668baded5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0453a8b2bb634303b77e24e668baded5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0453a8b2bb634303b77e24e668baded5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0453a8b2bb634303b77e24e668baded5", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:31:55.865487 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Tenant: admin Aug 17 08:31:55.865487 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Tenant-Id: 0453a8b2bb634303b77e24e668baded5 Aug 17 08:31:55.865487 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-Tenant-Name: admin Aug 17 08:31:55.865487 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-User: admin Aug 17 08:31:55.865487 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-User-Domain-Id: default Aug 17 08:31:55.865487 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-User-Domain-Name: Default Aug 17 08:31:55.865487 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-User-Id: 0f93f4121d434aed821124eb6820eb0b Aug 17 08:31:55.865487 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: X-User-Name: admin Aug 17 08:31:55.865487 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: method: > Aug 17 08:31:55.865487 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: exception: Flavor 451 could not be found. Aug 17 08:31:55.865487 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: action_args: {'id': '451'} Aug 17 08:31:55.865487 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:31:55.865487 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:31:55.866425 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 08:31:55.866425 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 08:31:55.866425 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 08:31:55.866425 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 08:31:55.866425 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 08:31:55.866425 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 08:31:55.866425 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 08:31:55.866425 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 08:31:55.866425 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 08:31:55.866425 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:31:55.866425 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 08:31:55.866425 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 08:31:55.866425 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 17 08:31:55.866425 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi Aug 17 08:31:55.866425 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:31:55.866425 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi Aug 17 08:31:55.866425 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:31:55.866425 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:31:55.866425 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:31:55.868198 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:31:55.868198 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:31:55.868198 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:31:55.868198 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:31:55.868198 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 08:31:55.868198 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:31:55.868198 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 17 08:31:55.868198 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi Aug 17 08:31:55.868198 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:31:55.868198 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi Aug 17 08:31:55.868198 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:31:55.868198 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:31:55.868198 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:31:55.868198 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:31:55.868198 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:31:55.868198 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 17 08:31:55.868198 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: ERROR nova.api.openstack.wsgi Aug 17 08:31:55.868198 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-f9e2f3db-6d59-4a08-b388-361c41109d16 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:31:55.869338 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-f9e2f3db-6d59-4a08-b388-361c41109d16 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.388631 Aug 17 08:31:55.869338 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 25/49] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Aug 17 08:31:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 08:31:55.875320 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-b869055e-4de3-4d9c-b0ab-53b79ebfc129 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:55.889981 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-b869055e-4de3-4d9c-b0ab-53b79ebfc129 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018198 Aug 17 08:31:55.890502 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 25/50] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Aug 17 08:31:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 08:31:55.900180 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-2108e910-0ee9-4a40-984e-9234e90a7403 admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:55.915468 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-2108e910-0ee9-4a40-984e-9234e90a7403 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019327 Aug 17 08:31:55.916341 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 26/51] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Aug 17 08:31:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:31:55.925614 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-dedd45dd-b150-456c-8aa4-bd0b814605ad admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:55.930918 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.wsgi [None req-dedd45dd-b150-456c-8aa4-bd0b814605ad admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 17 08:31:55.932437 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-dedd45dd-b150-456c-8aa4-bd0b814605ad admin admin] Request method failure captured: Aug 17 08:31:55.932437 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 17 08:31:55.932437 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: Accept: application/json Aug 17 08:31:55.932437 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: Accept-Encoding: gzip, deflate Aug 17 08:31:55.932437 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: Connection: keep-alive Aug 17 08:31:55.932437 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: Content-Length: 0 Aug 17 08:31:55.932437 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: Host: 10.222.0.15 Aug 17 08:31:55.932437 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: Openstack-Api-Version: compute 2.90 Aug 17 08:31:55.932437 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: Openstack-System-Scope: None Aug 17 08:31:55.932437 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: User-Agent: python-novaclient Aug 17 08:31:55.932437 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Auth-Token: gAAAAABi_Kd7DUajTN9dTENGVRg38mgFZnI9IAs97sX4hddJ2v-LHHOAOtLV-0BaMmKrnxUDnVRsF2xDj4pxvVjv1vzVZQkfpg7qXhMyUx2ma2Blax3MTluukLRhZ3L7u5ND3vebkYzc1u0uh-w3HbZUX72jANBzhkCL-bJNt9auny0h8GWHTrk Aug 17 08:31:55.932437 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Domain-Id: None Aug 17 08:31:55.932437 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Domain-Name: None Aug 17 08:31:55.932437 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Identity-Status: Confirmed Aug 17 08:31:55.932437 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Is-Admin-Project: True Aug 17 08:31:55.932437 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 08:31:55.932437 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Project-Domain-Id: default Aug 17 08:31:55.932437 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Project-Domain-Name: Default Aug 17 08:31:55.932437 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Project-Id: 0453a8b2bb634303b77e24e668baded5 Aug 17 08:31:55.932437 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Project-Name: admin Aug 17 08:31:55.932437 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Role: admin,member,reader Aug 17 08:31:55.932437 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Roles: admin,member,reader Aug 17 08:31:55.933752 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0453a8b2bb634303b77e24e668baded5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0453a8b2bb634303b77e24e668baded5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0453a8b2bb634303b77e24e668baded5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0453a8b2bb634303b77e24e668baded5", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:31:55.933752 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Tenant: admin Aug 17 08:31:55.933752 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Tenant-Id: 0453a8b2bb634303b77e24e668baded5 Aug 17 08:31:55.933752 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-Tenant-Name: admin Aug 17 08:31:55.933752 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-User: admin Aug 17 08:31:55.933752 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-User-Domain-Id: default Aug 17 08:31:55.933752 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-User-Domain-Name: Default Aug 17 08:31:55.933752 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-User-Id: 0f93f4121d434aed821124eb6820eb0b Aug 17 08:31:55.933752 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: X-User-Name: admin Aug 17 08:31:55.933752 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: method: > Aug 17 08:31:55.933752 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: exception: Flavor 451 could not be found. Aug 17 08:31:55.933752 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: action_args: {'id': '451'} Aug 17 08:31:55.933752 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:31:55.933752 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:31:55.934604 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 08:31:55.934604 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 08:31:55.934604 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 08:31:55.934604 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 08:31:55.934604 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 08:31:55.934604 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 08:31:55.934604 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 08:31:55.934604 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 08:31:55.934604 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 08:31:55.934604 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:31:55.934604 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 08:31:55.934604 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 08:31:55.934604 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 17 08:31:55.934604 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Aug 17 08:31:55.934604 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:31:55.934604 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Aug 17 08:31:55.934604 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:31:55.934604 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:31:55.934604 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:31:55.935976 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:31:55.935976 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:31:55.935976 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:31:55.935976 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:31:55.935976 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 08:31:55.935976 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:31:55.935976 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 17 08:31:55.935976 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Aug 17 08:31:55.935976 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:31:55.935976 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Aug 17 08:31:55.935976 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:31:55.935976 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:31:55.935976 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:31:55.935976 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:31:55.935976 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:31:55.935976 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 17 08:31:55.935976 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: ERROR nova.api.openstack.wsgi Aug 17 08:31:55.935976 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-dedd45dd-b150-456c-8aa4-bd0b814605ad admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:31:55.937260 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-dedd45dd-b150-456c-8aa4-bd0b814605ad admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011734 Aug 17 08:31:55.937260 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 26/52] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Aug 17 08:31:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 08:31:56.895500 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-2108e910-0ee9-4a40-984e-9234e90a7403 admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:56.896520 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-2108e910-0ee9-4a40-984e-9234e90a7403 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 17 08:31:56.896914 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 27/53] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 08:31:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:31:57.420529 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-facb7a8b-8658-47a9-ac84-d23bb0cab208 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:31:57.440210 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-facb7a8b-8658-47a9-ac84-d23bb0cab208 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.405896 Aug 17 08:31:57.440782 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 27/54] 10.222.0.15 () {64 vars in 1235 bytes} [Wed Aug 17 08:31:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 08:31:58.398026 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-2108e910-0ee9-4a40-984e-9234e90a7403 admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:58.399018 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-2108e910-0ee9-4a40-984e-9234e90a7403 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Aug 17 08:31:58.399413 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 28/55] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 08:31:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:31:58.919312 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-a90aeecf-e7df-490f-ba18-9203548178ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:31:58.936618 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-a90aeecf-e7df-490f-ba18-9203548178ad admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.400399 Aug 17 08:31:58.937157 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 28/56] 10.222.0.15 () {64 vars in 1235 bytes} [Wed Aug 17 08:31:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 08:31:59.899834 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-2108e910-0ee9-4a40-984e-9234e90a7403 admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:31:59.900860 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-2108e910-0ee9-4a40-984e-9234e90a7403 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 17 08:31:59.901253 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 29/57] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 08:31:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:32:00.418137 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-61cee219-5d50-4885-92f1-5c96355343c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:32:00.436648 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-61cee219-5d50-4885-92f1-5c96355343c9 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.398542 Aug 17 08:32:00.437190 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 29/58] 10.222.0.15 () {64 vars in 1235 bytes} [Wed Aug 17 08:32:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 08:32:01.407128 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-2108e910-0ee9-4a40-984e-9234e90a7403 admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:32:01.408167 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-2108e910-0ee9-4a40-984e-9234e90a7403 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 17 08:32:01.408568 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 30/59] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 08:32:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:32:01.926040 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-df4f74a7-efa2-4c5a-be54-f8f18675b6a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:32:01.944221 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-df4f74a7-efa2-4c5a-be54-f8f18675b6a7 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.398396 Aug 17 08:32:01.944760 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 30/60] 10.222.0.15 () {64 vars in 1235 bytes} [Wed Aug 17 08:32:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 08:32:02.902809 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-2108e910-0ee9-4a40-984e-9234e90a7403 admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:32:02.903854 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-2108e910-0ee9-4a40-984e-9234e90a7403 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 17 08:32:02.904251 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 31/61] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 08:32:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:32:03.417172 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-08236bf9-b685-4c10-8f64-6218c6787bde admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:32:03.437069 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-08236bf9-b685-4c10-8f64-6218c6787bde admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.397469 Aug 17 08:32:03.437604 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 31/62] 10.222.0.15 () {60 vars in 1202 bytes} [Wed Aug 17 08:32:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:32:56.038320 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-2108e910-0ee9-4a40-984e-9234e90a7403 admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:32:56.039330 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-2108e910-0ee9-4a40-984e-9234e90a7403 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 17 08:32:56.039764 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 32/63] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 08:32:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:32:56.050540 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:56.424878 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-49a10014-8471-4bb9-9d37-8ea80a4c616e admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:32:56.444919 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-49a10014-8471-4bb9-9d37-8ea80a4c616e admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.398858 Aug 17 08:32:56.445458 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 32/64] 10.222.0.15 () {60 vars in 1292 bytes} [Wed Aug 17 08:32:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 08:32:56.467286 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG dbcounter [-] [105762] Writing DB stats nova_api:SELECT=14 {{(pid=105762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:32:56.471076 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-0c0afdb2-496f-480b-ba4a-ae3b05ed2829 admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:32:56.478809 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-0c0afdb2-496f-480b-ba4a-ae3b05ed2829 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013005 Aug 17 08:32:56.479316 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 33/65] 10.222.0.15 () {60 vars in 1283 bytes} [Wed Aug 17 08:32:56 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:32:56.490561 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-c83f46ba-46da-4f5c-b7dd-a05c257d6446 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:32:56.498052 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-c83f46ba-46da-4f5c-b7dd-a05c257d6446 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011039 Aug 17 08:32:56.498560 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 33/66] 10.222.0.15 () {60 vars in 1286 bytes} [Wed Aug 17 08:32:56 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:32:56.509791 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-d85ffaa3-e0c6-492b-a2ce-139593a225f0 admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:32:56.516976 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-d85ffaa3-e0c6-492b-a2ce-139593a225f0 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011081 Aug 17 08:32:56.517483 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 34/67] 10.222.0.15 () {60 vars in 1286 bytes} [Wed Aug 17 08:32:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:32:56.529077 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-7d65bcba-f289-4292-bf43-1122bea23c61 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:32:56.536418 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-7d65bcba-f289-4292-bf43-1122bea23c61 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010723 Aug 17 08:32:56.536924 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 34/68] 10.222.0.15 () {60 vars in 1283 bytes} [Wed Aug 17 08:32:56 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:35:47.359280 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-d85ffaa3-e0c6-492b-a2ce-139593a225f0 admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:35:47.360320 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-d85ffaa3-e0c6-492b-a2ce-139593a225f0 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 17 08:35:47.360716 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 35/69] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 08:35:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:35:47.499397 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writing DB stats nova_api:SELECT=6 {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:35:47.657811 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-87218668-4abf-4487-b70b-047a43540245 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:35:47.660299 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 08:35:47.660299 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: warnings.warn(msg) Aug 17 08:35:47.661422 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-87218668-4abf-4487-b70b-047a43540245 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:35:47.661901 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-87218668-4abf-4487-b70b-047a43540245 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:35:47.662329 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-87218668-4abf-4487-b70b-047a43540245 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:35:47.663040 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-87218668-4abf-4487-b70b-047a43540245 admin admin] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:35:47.663490 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-87218668-4abf-4487-b70b-047a43540245 admin admin] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:35:47.663931 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-87218668-4abf-4487-b70b-047a43540245 admin admin] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:35:47.697492 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-87218668-4abf-4487-b70b-047a43540245 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.199722 Aug 17 08:35:47.698052 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 35/70] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Aug 17 08:35:47 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 08:35:48.521915 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-d85ffaa3-e0c6-492b-a2ce-139593a225f0 admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:35:48.523831 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-d85ffaa3-e0c6-492b-a2ce-139593a225f0 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002512 Aug 17 08:35:48.524549 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 36/71] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 08:35:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:35:48.715442 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-1a99c62f-62d4-4715-bb36-c29f36f531d1 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:35:48.717863 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 08:35:48.717863 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: warnings.warn(msg) Aug 17 08:35:48.718969 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-1a99c62f-62d4-4715-bb36-c29f36f531d1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:35:48.719476 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-1a99c62f-62d4-4715-bb36-c29f36f531d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:35:48.719947 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-1a99c62f-62d4-4715-bb36-c29f36f531d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:35:48.720653 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-1a99c62f-62d4-4715-bb36-c29f36f531d1 admin admin] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:35:48.721110 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-1a99c62f-62d4-4715-bb36-c29f36f531d1 admin admin] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:35:48.721514 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-1a99c62f-62d4-4715-bb36-c29f36f531d1 admin admin] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:35:48.741172 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-1a99c62f-62d4-4715-bb36-c29f36f531d1 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078350 Aug 17 08:35:48.741658 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 36/72] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Aug 17 08:35:48 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 08:35:59.965805 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-d85ffaa3-e0c6-492b-a2ce-139593a225f0 admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:35:59.966802 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-d85ffaa3-e0c6-492b-a2ce-139593a225f0 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Aug 17 08:35:59.967229 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 37/73] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 08:35:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:36:00.107264 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writing DB stats nova_cell0:SELECT=4 {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:36:00.107984 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writing DB stats nova_cell1:SELECT=4 {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:36:00.108578 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG dbcounter [-] [105763] Writing DB stats nova_api:SELECT=8 {{(pid=105763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:36:00.155794 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-bec4c150-1c4f-4584-b29f-11d3bdcb6270 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:36:00.158377 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 08:36:00.158377 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: warnings.warn(msg) Aug 17 08:36:00.159660 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-bec4c150-1c4f-4584-b29f-11d3bdcb6270 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:36:00.160228 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-bec4c150-1c4f-4584-b29f-11d3bdcb6270 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:36:00.160653 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-bec4c150-1c4f-4584-b29f-11d3bdcb6270 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:36:00.161363 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-bec4c150-1c4f-4584-b29f-11d3bdcb6270 admin admin] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:36:00.161801 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-bec4c150-1c4f-4584-b29f-11d3bdcb6270 admin admin] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:36:00.162209 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-bec4c150-1c4f-4584-b29f-11d3bdcb6270 admin admin] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:36:00.187423 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-bec4c150-1c4f-4584-b29f-11d3bdcb6270 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084455 Aug 17 08:36:00.187927 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 37/74] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Aug 17 08:36:00 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:36:01.010637 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: DEBUG nova.api.openstack.wsgi [None req-d85ffaa3-e0c6-492b-a2ce-139593a225f0 admin admin] Calling method '>' {{(pid=105762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:36:01.011656 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: INFO nova.api.openstack.requestlog [None req-d85ffaa3-e0c6-492b-a2ce-139593a225f0 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Aug 17 08:36:01.012052 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: [pid: 105762|app: 0|req: 38/75] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 08:36:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:36:01.200408 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG nova.api.openstack.wsgi [None req-a849d6d9-8166-4281-b83c-39bdb044fae1 admin admin] Calling method '>' {{(pid=105763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:36:01.202752 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 08:36:01.202752 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: warnings.warn(msg) Aug 17 08:36:01.203880 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-a849d6d9-8166-4281-b83c-39bdb044fae1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:36:01.204382 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-a849d6d9-8166-4281-b83c-39bdb044fae1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:36:01.204809 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-a849d6d9-8166-4281-b83c-39bdb044fae1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:36:01.205511 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-a849d6d9-8166-4281-b83c-39bdb044fae1 admin admin] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:36:01.205955 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-a849d6d9-8166-4281-b83c-39bdb044fae1 admin admin] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:36:01.206370 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: DEBUG oslo_concurrency.lockutils [None req-a849d6d9-8166-4281-b83c-39bdb044fae1 admin admin] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:36:01.227837 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: INFO nova.api.openstack.requestlog [None req-a849d6d9-8166-4281-b83c-39bdb044fae1 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078588 Aug 17 08:36:01.228318 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: [pid: 105763|app: 0|req: 38/76] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Aug 17 08:36:01 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:36:56.386648 dv-cinder-853315-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 17 08:36:56.387551 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: Wed Aug 17 08:36:56 2022 - graceful shutdown triggered... Aug 17 08:36:56.388046 dv-cinder-853315-5-iscsi devstack@n-api.service[105763]: Gracefully killing worker 2 (pid: 105763)... Aug 17 08:36:56.388433 dv-cinder-853315-5-iscsi devstack@n-api.service[105762]: Gracefully killing worker 1 (pid: 105762)... Aug 17 08:36:57.389426 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: worker 1 buried after 1 seconds Aug 17 08:36:57.389426 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: worker 2 buried after 1 seconds Aug 17 08:36:57.389426 dv-cinder-853315-5-iscsi devstack@n-api.service[105761]: goodbye to uWSGI. Aug 17 08:36:57.390269 dv-cinder-853315-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 17 08:36:57.390811 dv-cinder-853315-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 17 08:36:57.393606 dv-cinder-853315-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 17 08:36:57.403896 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 17 08:36:57.406456 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 08:36:57 2022] *** Aug 17 08:36:57.406605 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 08:36:57.406739 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 08:36:57.406857 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: nodename: dv-cinder-853315-5-iscsi Aug 17 08:36:57.406968 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: machine: x86_64 Aug 17 08:36:57.407096 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: clock source: unix Aug 17 08:36:57.407096 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: pcre jit disabled Aug 17 08:36:57.407096 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: detected number of CPU cores: 4 Aug 17 08:36:57.407096 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: current working directory: / Aug 17 08:36:57.407096 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: detected binary path: /usr/bin/uwsgi-core Aug 17 08:36:57.407096 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: your processes number limit is 47680 Aug 17 08:36:57.407096 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: your memory page size is 4096 bytes Aug 17 08:36:57.407096 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: detected max file descriptor number: 2048 Aug 17 08:36:57.407096 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: lock engine: pthread robust mutexes Aug 17 08:36:57.407799 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: thunder lock: enabled Aug 17 08:36:57.407799 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 17 08:36:57.407799 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 08:36:57.446826 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: Python main interpreter initialized at 0x563b4b4269c0 Aug 17 08:36:57.446826 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: python threads support enabled Aug 17 08:36:57.446826 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: your server socket listen backlog is limited to 100 connections Aug 17 08:36:57.446826 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: your mercy for graceful operations on workers is 90 seconds Aug 17 08:36:57.447256 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 08:36:57.447256 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: *** Operational MODE: preforking *** Aug 17 08:36:57.447566 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: *** uWSGI is running in multiple interpreter mode *** Aug 17 08:36:57.447566 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: spawned uWSGI master process (pid: 127276) Aug 17 08:36:57.460684 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: spawned uWSGI worker 1 (pid: 127297, cores: 1) Aug 17 08:36:57.460684 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: spawned uWSGI worker 2 (pid: 127298, cores: 1) Aug 17 08:36:57.460684 dv-cinder-853315-5-iscsi devstack@n-api.service[127276]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 08:36:57.447764 dv-cinder-853315-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 17 08:36:58.102733 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 08:36:58.103346 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 08:36:59.247489 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 08:36:59.247489 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: from cryptography.utils import int_from_bytes Aug 17 08:36:59.248221 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 08:36:59.248221 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: from cryptography.utils import int_from_bytes Aug 17 08:36:59.248912 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 08:36:59.248912 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: from cryptography.utils import int_from_bytes Aug 17 08:36:59.249371 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 08:36:59.249371 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: from cryptography.utils import int_from_bytes Aug 17 08:37:01.557097 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 08:37:01.557672 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 08:37:01.557939 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 08:37:01.558228 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 08:37:01.558483 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 08:37:01.558659 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 08:37:01.559033 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.559118 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 08:37:01.559199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.559417 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 08:37:01.559527 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.559813 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 08:37:01.559929 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.560108 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 08:37:01.560219 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.560446 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.560558 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.560771 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.560920 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.561092 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.561210 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.561417 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.561553 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.561830 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.561947 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.562160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.562280 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.562517 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.562697 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853315-5-iscsi {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.562886 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.563197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.563318 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.563553 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.563668 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.563855 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.563965 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.564161 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.564281 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.564485 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853315-5-iscsi {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.564578 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.564790 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.564889 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.565100 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.565292 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.565410 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.565745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.565849 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.566052 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.566571 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.566659 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.566742 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.566827 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.566901 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.566990 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.567286 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.567397 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.567634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.567797 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.567942 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.568145 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.568251 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.568456 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.568558 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.568792 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.568934 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853315-5-iscsi {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.569686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.569893 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.570095 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.570253 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.570396 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.570498 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.570813 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.570994 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.571156 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.571356 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.571519 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.571761 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.571927 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.572084 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853315-5-iscsi {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.572285 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.572392 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.572585 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.572746 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.572838 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.572985 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.573127 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.573302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.573531 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.573664 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.573894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.574013 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.574203 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.574316 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.574510 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.574609 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.574828 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.574929 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.575134 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.575243 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.575439 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.575575 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.575716 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.575855 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.576024 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.576174 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.576345 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.576493 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.576670 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.576833 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.577045 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.577197 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.577380 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.577531 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.577691 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.577842 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.578002 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.578164 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.578313 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.578412 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.578511 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.578611 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.578704 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.578798 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.578943 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.579088 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.579249 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.579405 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.579584 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.579749 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.579886 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.579981 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.580189 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.580283 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.580495 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.580609 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.580807 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.580901 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.581121 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.581221 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.581429 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.581531 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.581730 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.581833 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.582034 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.582149 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.582337 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.582474 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.582639 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.582992 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.583495 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.583705 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.583830 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.583952 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.584071 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.584201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.584305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.584395 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.584490 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.584584 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.585295 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.585408 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.585542 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.585685 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.585881 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.586022 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.586160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.586299 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.586454 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.586557 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.586789 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.586884 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.587096 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.587200 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.587346 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.587444 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.587671 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.587784 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.587977 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.588072 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.588294 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.588398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.588598 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.588705 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.588899 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.588993 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.589202 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.589301 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.589500 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.589599 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.589810 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.589912 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.590056 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.590201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.590341 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.590472 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.590642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.590764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.590959 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.591087 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.591267 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.591405 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.591588 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.591726 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.591895 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.592024 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.592192 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.592589 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.592717 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.592831 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.592952 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.593074 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.593195 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.593321 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.593442 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.593656 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.593834 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.593961 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.594083 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.594230 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.594361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.594499 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.594642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.594783 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.594923 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.595063 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.595199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.595336 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.595487 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.595781 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.595933 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.596066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.596208 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.596353 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.596484 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.596628 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.596777 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.596911 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.597049 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.597843 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.597983 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.598105 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.598234 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.598361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.598496 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.598621 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.598744 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.598864 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.598987 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.599105 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.599219 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.599331 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.599451 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.599609 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.599739 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.599852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.599975 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.600095 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.600207 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.600330 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.600453 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.600574 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.600694 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.600807 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.600927 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.601114 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.602230 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.602620 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.602771 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.602904 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.603035 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.603169 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.603290 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.603404 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.603518 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.603694 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.603937 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.604074 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.604197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.604317 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.604449 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.604564 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.604682 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.604805 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.604919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.605031 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.605149 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.605261 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.605386 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.605506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.605620 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.605731 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.605851 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.605964 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 08:37:01.606093 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.606213 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.606334 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.606453 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.606587 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.606725 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.606871 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.607009 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.607150 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.607280 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.607410 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.607662 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.607798 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.607941 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.608080 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.608218 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.608218 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.608490 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.608668 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.608810 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.608976 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.609128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.609267 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.610278 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.610372 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.610471 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.610568 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.610665 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.610752 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.610851 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.610952 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.611047 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.611135 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.611229 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.611326 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.611423 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.611602 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.611750 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.612061 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.612173 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.612271 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.612442 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.612613 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.612776 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.612870 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.613095 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.613206 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.613412 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.613513 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.613739 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.613833 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.614061 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.614173 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.614380 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.614484 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.614691 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.614785 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.615001 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.615112 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.615313 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.615407 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.615646 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.615743 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.615989 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.616108 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.616305 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.616412 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.616620 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.616720 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.616930 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.617053 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.617240 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.617335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.617550 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.617643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.617859 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.617961 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.618166 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.618262 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.618477 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.618570 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.618791 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.618896 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.619099 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.619204 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.619404 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.619562 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.619740 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.619834 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.620048 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.620190 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.620351 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.620454 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.620658 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.620752 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.620961 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.621063 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.621270 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.621375 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.621573 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.621675 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.621881 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.622016 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.622183 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.622290 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.622493 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.622593 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.622806 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.622899 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.623107 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.623214 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.623419 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.623521 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.623752 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.623845 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.624058 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.624212 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.624365 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.624466 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.624674 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.624777 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.624977 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.625073 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.625285 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.625387 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.625591 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.625731 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.625894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.625986 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.626208 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.626301 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.626515 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.626608 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.626818 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.626912 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.627136 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.627230 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.627438 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.627633 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.627764 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.627868 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.628077 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.628179 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.628386 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.628495 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.628695 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.628830 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.629002 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.629137 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.629310 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.629419 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.629632 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.629735 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.629941 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.630043 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.630248 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.630356 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.630551 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.630650 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.630862 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.630998 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.631168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.631302 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.632051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.632342 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.632484 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.632585 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.632706 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.632802 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.633012 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.633142 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.633315 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.633438 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.633620 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.633749 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.633924 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.634233 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.634548 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.634774 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.634910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.635088 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.635218 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.635403 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.635524 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.635737 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.635868 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.636044 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.636174 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.636348 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.636478 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.636651 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.636784 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.636954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.637076 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.637275 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.637414 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.637584 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.637680 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.637888 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.637989 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.638190 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.638536 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.638647 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.638791 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.638930 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.639031 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.639118 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.639263 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.639431 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.639525 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.643692 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.643791 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.643879 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.643969 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.644045 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.644117 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.644198 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.644271 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.644350 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.644432 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.644513 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.644587 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.644658 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.644729 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.644816 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.644897 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.644971 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.645049 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.645129 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.645208 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.645314 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.645403 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.645488 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.645561 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.645633 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.645704 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.645784 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.645864 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.645937 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.646014 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.646087 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.646163 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.646246 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.646325 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.646405 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.646484 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.646557 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.646636 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.646721 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.646800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.646873 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.646944 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.647022 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.647130 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.647257 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.648926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.649090 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.649254 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.649415 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.649568 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.649746 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.649919 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.650065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.650221 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.650365 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.650516 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.650661 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.650811 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.650811 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.651110 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.651254 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.651406 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.651575 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.651737 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.651882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.652025 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.652166 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.652319 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.652500 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.652672 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.652826 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.652969 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.653129 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.653282 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.653432 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.653582 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.653732 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.653884 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.654036 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.654179 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.654329 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.654472 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.654614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.655725 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.655897 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.656055 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.656227 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.656384 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.656527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.656670 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.656826 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.656979 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.657123 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.657273 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.657416 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.657558 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.657714 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.657865 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.658019 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.658322 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.658489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.658647 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.658798 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.658957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.659109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.659260 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.659403 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.659582 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.659733 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.659877 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.660029 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.660173 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.660315 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.660528 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.660688 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.660833 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.660982 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.661127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.661268 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.661426 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.661577 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.661732 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.661881 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.662035 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.662188 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.662333 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.662483 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.662635 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.662856 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.663044 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.663203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.663355 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.663505 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.663692 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.663837 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.663979 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.664144 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.664298 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.664440 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.664637 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.664839 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.665121 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.665675 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.665932 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.666089 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.666241 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.666388 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.666549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.666700 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.666854 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.666996 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.667138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.667308 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.667466 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.667642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.667798 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.667942 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.668084 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.668226 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.668381 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.668533 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.668676 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.668837 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.668989 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.669130 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.669130 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.669411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.669555 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.669704 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.669854 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.670011 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.670154 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.670303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.670454 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.670614 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.670758 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.670758 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.671045 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.671815 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.671980 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.671980 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.672272 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.672425 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.672569 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.672723 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.672881 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.673033 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.673199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.673342 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.673485 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.673635 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.673793 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.673938 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.674088 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.674239 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.674389 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.674541 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.674541 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.674830 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.674980 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.675260 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.675803 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.675984 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.676224 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.676384 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.676537 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.676696 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.676850 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.677001 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.677154 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.677297 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.677447 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.677612 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.677612 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.677886 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.678028 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.678171 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.678313 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.678505 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.678716 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.678866 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.679010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.679153 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.679308 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.679460 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.679654 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.679812 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.679965 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.680110 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.680267 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.680411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.680571 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.680764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.680912 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.681063 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.681256 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.681413 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.681566 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.681727 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.681877 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.682021 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.682215 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.682364 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.682514 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.682666 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.682817 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.682975 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.683126 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.683271 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.683421 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.683603 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.683761 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.683958 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.684105 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.684248 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.684398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.684549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.684692 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.684843 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.684986 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.685140 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.685395 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.685973 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.686180 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.686440 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.686598 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.686743 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.686886 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.687037 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.687203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.687349 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.687491 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.687669 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.687814 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.687957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.688114 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.688269 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.688413 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.688564 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.688708 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.688859 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.689015 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.689167 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.689311 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.689456 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.689598 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.689754 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.689907 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.690051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.690203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.690354 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.690499 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.690652 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.690796 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.690939 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.691089 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.691239 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.691382 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.691642 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.692317 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.692471 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.692624 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.692787 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.692930 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.693083 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.693226 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.693377 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.693533 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.693686 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.693829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.694526 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.694724 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.694871 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.695063 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.695224 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.695396 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.695658 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.696215 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.696369 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.696611 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.696770 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.696927 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.697080 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.697223 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.697366 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.697515 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.697658 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.697825 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.697970 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.698112 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.698262 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.698405 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.698556 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.698556 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.698845 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.698990 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.699139 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.699283 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.699446 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.699655 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.699823 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.699969 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.700118 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.700269 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.700538 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.700690 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.700835 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.700979 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.701129 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.701129 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.701410 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.701563 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.701714 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.701876 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.702028 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.702185 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.702337 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.702497 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.702659 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.702897 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.703047 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.703198 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.703349 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.703491 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.703658 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.703811 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.703965 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.704124 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.704275 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.704434 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.704584 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.704734 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.704885 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.705042 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.705186 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.705344 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.705495 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.705694 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.706336 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.706504 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.706659 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.706809 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.707057 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.707208 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.707363 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.707507 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.707687 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.708084 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.708237 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.708389 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.708547 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.708700 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.708844 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.708993 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.709137 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.709285 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.709445 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.709623 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.710342 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.710488 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.710630 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.710780 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.710937 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.711087 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.711250 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.711400 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.711571 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.711738 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.711891 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.712034 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.712177 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.712319 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.712463 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.712619 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.712771 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.712914 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.713056 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.713216 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.713368 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.713520 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.713665 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.713807 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.713949 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.714098 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.714242 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.714392 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.714542 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.714686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.714836 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.714996 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.715153 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.715304 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.715447 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.715677 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.715837 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.716095 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.716667 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.716814 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.716975 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.717224 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.717224 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.717521 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.717685 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.717830 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.717982 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.718126 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.718275 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.718426 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.718580 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.718741 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.718885 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.719028 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.719170 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.719330 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.719481 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.719676 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.719823 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.719973 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.720129 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.720288 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.720447 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.720598 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.720754 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.720912 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.721069 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.721234 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.721392 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.721549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.721717 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.721877 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.722036 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.722196 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.722346 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.722496 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.722652 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.722801 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.722964 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.723126 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.723285 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.723435 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.723612 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.723768 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.723929 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.724081 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.724231 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.724381 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.724536 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.724686 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.724848 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.724848 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.725134 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.725315 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.725476 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.725650 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.725810 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.725962 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.726202 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.726791 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.726959 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.727121 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.727375 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.727532 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.727754 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.727905 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.728054 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.728054 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.728371 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.728522 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.728672 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.728822 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.728979 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.729140 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.729305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.729466 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.729616 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.729778 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.729936 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.730087 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.730246 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.730397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.730554 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.730554 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.730853 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.731003 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.731154 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.731303 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.731463 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.731646 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.731801 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.731950 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.732107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.732268 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.732434 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.732594 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.732753 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.732909 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.733060 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.733217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.733380 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.733539 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.733690 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.733846 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.734004 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.734162 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.734336 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.734488 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.734638 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.734794 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.734945 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.735100 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.735260 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.735411 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.735582 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.735750 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.735902 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.736059 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.736237 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.736484 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.737083 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.737243 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.737413 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.737660 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.737824 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.737990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.738150 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.738309 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.738460 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.738624 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.738776 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.738937 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.739088 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.739237 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.739387 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.739637 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.739808 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.739959 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.740109 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.740264 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.740422 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.740582 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.740742 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.740922 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.741087 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.741245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.741410 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.741561 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.741718 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.741869 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.742026 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.742177 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.742336 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.742494 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.742653 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.742810 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.742968 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.743136 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.743297 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.743453 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.743678 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.743834 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.743993 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.744157 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.744316 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.744466 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.744616 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.744765 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.744915 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.745074 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.745242 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.745401 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.745551 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.745707 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.745859 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.746018 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.746176 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.746326 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.746501 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.747130 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.747302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.747467 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.747669 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.747902 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.748070 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.748229 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.748436 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.748593 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.748744 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.748902 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.749053 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.749204 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.749368 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.749529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.749688 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.749849 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.749999 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.750148 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.750312 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.750470 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.750628 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.750784 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.750934 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.751084 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.751243 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.751395 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.751570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.751739 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.751901 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.752066 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.752224 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.752376 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.752533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.752684 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.752834 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.752997 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.753148 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.753305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.753457 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.753614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.753775 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.753934 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.754093 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.754244 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.754394 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.754544 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.754709 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.754915 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.755075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.755227 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.755376 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.755527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.755751 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.755916 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.756074 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.756231 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.756381 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.757524 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.757524 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.757844 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.758107 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.758265 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.758496 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.758671 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.758833 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.758992 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.759161 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.759312 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.759470 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.759656 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.759656 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.759956 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.760106 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.760256 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.760420 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.760579 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.760740 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.760899 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.761065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.761225 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.761225 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.761533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.761684 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.761842 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.762001 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.762152 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.762302 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.762461 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.762621 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.762772 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.762933 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.763084 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.763312 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.763465 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.763660 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.763816 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.763966 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.764116 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.764283 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.764435 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.764591 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.764741 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.764910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.765075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.765233 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.765391 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.765548 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.765709 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.765859 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.766023 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.766173 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.766323 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.766482 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.766633 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.766802 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.766953 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.767111 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.767770 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.767940 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.768120 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.768364 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.768521 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.768679 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.768838 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.768989 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.769140 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.769310 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.769470 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.769621 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.769777 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.769928 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.770085 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.770246 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.770397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.770553 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.770705 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.770854 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.771081 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.771244 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.771414 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.771647 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.771647 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.771942 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.772150 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.772815 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.772815 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.773111 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.773268 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.773426 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.773590 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.773741 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.773909 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.774067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.774218 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.774388 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.774547 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.774697 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.774846 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.774995 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.775152 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.775310 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.775510 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.775686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.775839 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.776010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.776162 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.776326 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.776485 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.776635 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.776785 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.776941 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.777092 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.777255 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.777255 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.778058 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.778210 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.778379 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.778634 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.778800 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.778959 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.779111 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.779111 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.779415 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.779606 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.779765 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.779922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.780080 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.780232 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.780390 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.780564 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.780671 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.780761 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.780895 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.780993 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.781124 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.781243 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.781331 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.781417 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.781508 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.781608 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.781703 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.781799 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.781892 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.781979 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.782065 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.782150 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.782290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.782393 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.782489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.782583 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.782669 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.782762 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.782861 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.782948 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.783041 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.783128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.783219 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.783312 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.783447 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.783625 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.783719 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.783817 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.783905 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.783999 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.784092 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.784180 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.784272 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.784443 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.784538 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.784634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.784728 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.784816 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.784901 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.784987 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.785110 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.785242 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.785353 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.785473 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.785590 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.785710 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.785822 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.785943 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.786055 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.786174 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.786286 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.786403 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.786528 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.786640 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.786750 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.786868 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.786987 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.787100 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.787222 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.787335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.787472 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.788621 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.788839 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.788974 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.789119 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.789251 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.789394 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.789534 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.789664 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.789792 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.789928 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.789928 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.790191 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.790342 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.790594 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.790738 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.790869 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.790997 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.791136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.791274 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.791405 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.791563 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.791696 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.791825 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.791954 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.791954 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.792214 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.792358 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.792488 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.792625 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.792754 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.792883 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.793011 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.793149 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.793287 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.793425 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.793554 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.793690 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.793828 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.793958 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.794086 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.794222 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.794361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.794498 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.794637 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.794637 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.794897 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.794897 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.795150 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.795279 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.795421 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.795609 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.795742 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.795871 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.795999 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.795999 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.795999 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.795999 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.795999 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.796603 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.796731 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.796874 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.797004 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.797133 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.797268 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.797402 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.797538 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.797963 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.798108 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.798239 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.798375 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.798775 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.799012 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.799148 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.799277 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.799406 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.799559 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.799691 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.799691 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.799960 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.800098 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.800234 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.800365 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.800365 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.800709 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.800842 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.800970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.801101 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.801101 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.801361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.801499 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.801630 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.801758 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.801758 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.802008 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.802148 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.802148 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.802390 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.802526 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.802526 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.802785 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.802927 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.803149 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.803290 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.803290 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.804102 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.804247 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.804377 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.804506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.804506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.804758 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.804894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.804894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.805159 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.805302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.805302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.805544 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.805684 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.805824 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.805953 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.805953 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.806194 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.806323 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.806323 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.806580 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.806710 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.806848 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.806977 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.807112 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.807256 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.807256 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.807518 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.807691 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.808040 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.808188 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.808188 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.808447 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.808660 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.808660 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.809089 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.809318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.809318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.809586 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.809716 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.809850 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.809980 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.809980 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.810230 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.810366 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.810366 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.810607 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.810825 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.810967 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.811101 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.811238 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.811368 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.811368 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.811625 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.811770 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.811770 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.812013 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.812144 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.812280 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.812410 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.812410 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.812670 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.812810 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.812940 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.813076 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.813076 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.813331 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.813459 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.813459 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.813720 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.813850 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.813987 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.814116 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.814254 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.814384 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.814384 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.814646 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.814785 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.814920 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.815050 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.815187 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.815326 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.815326 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.815603 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.815743 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.815743 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.815996 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.816132 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.816270 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.816401 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.816401 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.816657 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.816795 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.816924 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.817061 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.817061 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.817311 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.817451 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.817451 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.817702 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.817841 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.817841 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.818309 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.818454 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.818584 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.818799 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.818799 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.819237 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.819469 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.819469 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.819778 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.819919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.820050 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.820179 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.820179 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.820420 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.820550 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.820689 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.820834 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.820834 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.821161 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.821290 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.821290 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.821549 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.821687 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.821824 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.821962 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.821962 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 08:37:01.822223 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.822223 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.822223 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.822223 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.822223 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.822223 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.822223 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.822223 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.823210 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.823210 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.823622 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.823983 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.824363 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.824760 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.825139 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.825515 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.825892 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.826270 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.826663 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.827046 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.827423 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.827822 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.828212 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.828595 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.829108 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.829386 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.829742 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.830136 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.830530 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.830947 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.831348 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.831787 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.832183 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.832566 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.833216 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.833586 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 08:37:01.833896 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 08:37:01.972098 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO dbcounter [None req-b92d51bf-9174-4cd0-9e7a-d4f2ef224893 None None] Registered counter for database nova_api Aug 17 08:37:01.989216 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO dbcounter [None req-7716e44f-2dbf-435b-8383-4c276580f0c2 None None] Registered counter for database nova_api Aug 17 08:37:01.992539 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_db.sqlalchemy.engines [None req-b92d51bf-9174-4cd0-9e7a-d4f2ef224893 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127297) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 08:37:01.999110 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writer thread running {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 08:37:02.008590 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_db.sqlalchemy.engines [None req-7716e44f-2dbf-435b-8383-4c276580f0c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 08:37:02.015002 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writer thread running {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 08:37:02.055091 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.context [None req-b92d51bf-9174-4cd0-9e7a-d4f2ef224893 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cf0f308f-a8b1-436d-b844-51a4a733ef03(cell1) {{(pid=127297) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 08:37:02.059088 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b92d51bf-9174-4cd0-9e7a-d4f2ef224893 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:37:02.059605 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b92d51bf-9174-4cd0-9e7a-d4f2ef224893 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:37:02.061157 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b92d51bf-9174-4cd0-9e7a-d4f2ef224893 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:37:02.061900 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b92d51bf-9174-4cd0-9e7a-d4f2ef224893 None None] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:37:02.062360 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b92d51bf-9174-4cd0-9e7a-d4f2ef224893 None None] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:37:02.064337 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b92d51bf-9174-4cd0-9e7a-d4f2ef224893 None None] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:37:02.066296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO dbcounter [None req-b92d51bf-9174-4cd0-9e7a-d4f2ef224893 None None] Registered counter for database nova_cell0 Aug 17 08:37:02.070329 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO dbcounter [None req-b92d51bf-9174-4cd0-9e7a-d4f2ef224893 None None] Registered counter for database nova_cell1 Aug 17 08:37:02.070771 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.context [None req-7716e44f-2dbf-435b-8383-4c276580f0c2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cf0f308f-a8b1-436d-b844-51a4a733ef03(cell1) {{(pid=127298) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 08:37:02.074924 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7716e44f-2dbf-435b-8383-4c276580f0c2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:37:02.075203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7716e44f-2dbf-435b-8383-4c276580f0c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:37:02.076812 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7716e44f-2dbf-435b-8383-4c276580f0c2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:37:02.077570 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7716e44f-2dbf-435b-8383-4c276580f0c2 None None] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:37:02.077834 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_db.sqlalchemy.engines [None req-b92d51bf-9174-4cd0-9e7a-d4f2ef224893 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127297) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 08:37:02.078023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7716e44f-2dbf-435b-8383-4c276580f0c2 None None] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:37:02.079480 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_db.sqlalchemy.engines [None req-b92d51bf-9174-4cd0-9e7a-d4f2ef224893 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127297) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 08:37:02.080012 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7716e44f-2dbf-435b-8383-4c276580f0c2 None None] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:37:02.082014 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO dbcounter [None req-7716e44f-2dbf-435b-8383-4c276580f0c2 None None] Registered counter for database nova_cell0 Aug 17 08:37:02.085121 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writer thread running {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 08:37:02.086827 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO dbcounter [None req-7716e44f-2dbf-435b-8383-4c276580f0c2 None None] Registered counter for database nova_cell1 Aug 17 08:37:02.094936 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_db.sqlalchemy.engines [None req-7716e44f-2dbf-435b-8383-4c276580f0c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 08:37:02.096050 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_db.sqlalchemy.engines [None req-7716e44f-2dbf-435b-8383-4c276580f0c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 08:37:02.102345 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writer thread running {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 08:37:02.103600 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writer thread running {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 08:37:02.222421 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writer thread running {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 08:37:02.232934 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO dbcounter [None req-b92d51bf-9174-4cd0-9e7a-d4f2ef224893 None None] Registered counter for database nova_cell0 Aug 17 08:37:02.239530 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_db.sqlalchemy.engines [None req-b92d51bf-9174-4cd0-9e7a-d4f2ef224893 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127297) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 08:37:02.244440 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writer thread running {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 08:37:02.246478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO dbcounter [None req-7716e44f-2dbf-435b-8383-4c276580f0c2 None None] Registered counter for database nova_cell0 Aug 17 08:37:02.252863 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_db.sqlalchemy.engines [None req-7716e44f-2dbf-435b-8383-4c276580f0c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 08:37:02.257497 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writer thread running {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 08:37:02.563578 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: WARNING keystonemiddleware.auth_token [None req-b92d51bf-9174-4cd0-9e7a-d4f2ef224893 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 08:37:02.571870 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: WARNING keystonemiddleware.auth_token [None req-b92d51bf-9174-4cd0-9e7a-d4f2ef224893 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 08:37:02.574207 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: WARNING keystonemiddleware.auth_token [None req-7716e44f-2dbf-435b-8383-4c276580f0c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 08:37:02.582311 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: WARNING keystonemiddleware.auth_token [None req-7716e44f-2dbf-435b-8383-4c276580f0c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 08:37:02.917827 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: WARNING keystonemiddleware.auth_token [None req-b92d51bf-9174-4cd0-9e7a-d4f2ef224893 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 08:37:02.923855 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: WARNING keystonemiddleware.auth_token [None req-b92d51bf-9174-4cd0-9e7a-d4f2ef224893 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 08:37:02.925641 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: WARNING keystonemiddleware.auth_token [None req-7716e44f-2dbf-435b-8383-4c276580f0c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 08:37:02.930015 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563b4b4269c0 pid: 127297 (default app) Aug 17 08:37:02.931829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: WARNING keystonemiddleware.auth_token [None req-7716e44f-2dbf-435b-8383-4c276580f0c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 08:37:02.937969 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563b4b4269c0 pid: 127298 (default app) Aug 17 08:37:38.028510 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=3 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:38.030764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=3 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:38.031712 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=3 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:38.032580 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=3 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:38.136622 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=3 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:38.137716 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=3 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:38.138444 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=3 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:38.139213 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=3 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:37:39.446619 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-af58785e-383a-40a1-866a-f70cd44ae2fb tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] Action: 'create', calling method: .version_select at 0x7f3f8748e280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1807260164", "metadata": {"Type": "work"}}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:37:39.465003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-af58785e-383a-40a1-866a-f70cd44ae2fb tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] Request method failure captured: Aug 17 08:37:39.465003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 08:37:39.465003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:37:39.465003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:37:39.465003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:37:39.465003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 122 Aug 17 08:37:39.465003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:37:39.465003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:37:39.465003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:37:39.465003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:37:39.465003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_KjRTn1lukoraNV38YuuOid8zEp1DIs5btpg5SEZD-vad9aDt1f3vsECwaRcAcJrb-dWbhxEoxW9NN93qZRcu5bqdEyS3788Oi1zh1Br1qyHIz6j5_XFNpbhUC_BQSqTNdJieyHPdOGPaZmAzEj8zttfBYJtzbUF9LRKnBFxW-diKdE Aug 17 08:37:39.465003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:37:39.465003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:37:39.465003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:37:39.465003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:37:39.465003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:37:39.465003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:37:39.465003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: 4a9a1d62cecd479e916fb67cf6d0d612 Aug 17 08:37:39.465003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-VolumesNegativeTest-162882546 Aug 17 08:37:39.465003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:37:39.465003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:37:39.466752 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4a9a1d62cecd479e916fb67cf6d0d612"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4a9a1d62cecd479e916fb67cf6d0d612"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4a9a1d62cecd479e916fb67cf6d0d612"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4a9a1d62cecd479e916fb67cf6d0d612", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:37:39.466752 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-VolumesNegativeTest-162882546 Aug 17 08:37:39.466752 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 4a9a1d62cecd479e916fb67cf6d0d612 Aug 17 08:37:39.466752 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-VolumesNegativeTest-162882546 Aug 17 08:37:39.466752 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-VolumesNegativeTest-162882546-project Aug 17 08:37:39.466752 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:37:39.466752 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:37:39.466752 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: 93b81cbad1554da3b1ad42575737b4f4 Aug 17 08:37:39.466752 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-VolumesNegativeTest-162882546-project Aug 17 08:37:39.466752 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Aug 17 08:37:39.466752 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1807260164", "metadata": {"Type": "work"}}} Aug 17 08:37:39.466752 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: Aug 17 08:37:39.466752 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 08:37:39.467745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1807260164', 'metadata': {'Type': 'work'}}}} Aug 17 08:37:39.467745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:37:39.467745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:37:39.467745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 08:37:39.467745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 08:37:39.467745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 08:37:39.467745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise error Aug 17 08:37:39.467745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 17 08:37:39.467745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:39.467745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 17 08:37:39.467745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 08:37:39.467745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:39.467745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 08:37:39.467745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi '#$%' Aug 17 08:37:39.467745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:39.467745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:37:39.467745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:39.467745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:37:39.467745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:37:39.467745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:37:39.467745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:37:39.467745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:37:39.470470 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 08:37:39.470470 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 08:37:39.470470 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:37:39.470470 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:37:39.470470 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 08:37:39.470470 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 08:37:39.470470 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 08:37:39.470470 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 08:37:39.470470 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 08:37:39.470470 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 08:37:39.470470 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 08:37:39.470470 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:39.470470 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:37:39.470470 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:39.470470 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:37:39.470470 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:37:39.470470 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:37:39.470470 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 08:37:39.470470 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 08:37:39.472932 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 08:37:39.472932 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:39.472932 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-af58785e-383a-40a1-866a-f70cd44ae2fb tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:37:39.472932 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-af58785e-383a-40a1-866a-f70cd44ae2fb tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.449037 Aug 17 08:37:39.472932 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 1/1] 10.222.0.15 () {60 vars in 1156 bytes} [Wed Aug 17 08:37:38 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1455 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 08:37:39.492695 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-081cf33c-f344-436d-bfe4-14227f68d01c tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] Action: 'create', calling method: .version_select at 0x7f3f8748ef70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1893692622", "metadata": {"Type": "work"}}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:37:39.496404 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-081cf33c-f344-436d-bfe4-14227f68d01c tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] Request method failure captured: Aug 17 08:37:39.496404 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 08:37:39.496404 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:37:39.496404 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:37:39.496404 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:37:39.496404 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 120 Aug 17 08:37:39.496404 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:37:39.496404 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:37:39.496404 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:37:39.496404 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:37:39.496404 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_KjRTn1lukoraNV38YuuOid8zEp1DIs5btpg5SEZD-vad9aDt1f3vsECwaRcAcJrb-dWbhxEoxW9NN93qZRcu5bqdEyS3788Oi1zh1Br1qyHIz6j5_XFNpbhUC_BQSqTNdJieyHPdOGPaZmAzEj8zttfBYJtzbUF9LRKnBFxW-diKdE Aug 17 08:37:39.496404 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:37:39.496404 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:37:39.496404 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:37:39.496404 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:37:39.496404 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:37:39.496404 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:37:39.496404 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: 4a9a1d62cecd479e916fb67cf6d0d612 Aug 17 08:37:39.496404 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-VolumesNegativeTest-162882546 Aug 17 08:37:39.496404 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:37:39.496404 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:37:39.497753 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4a9a1d62cecd479e916fb67cf6d0d612"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4a9a1d62cecd479e916fb67cf6d0d612"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4a9a1d62cecd479e916fb67cf6d0d612"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4a9a1d62cecd479e916fb67cf6d0d612", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:37:39.497753 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-VolumesNegativeTest-162882546 Aug 17 08:37:39.497753 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 4a9a1d62cecd479e916fb67cf6d0d612 Aug 17 08:37:39.497753 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-VolumesNegativeTest-162882546 Aug 17 08:37:39.497753 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-VolumesNegativeTest-162882546-project Aug 17 08:37:39.497753 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:37:39.497753 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:37:39.497753 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: 93b81cbad1554da3b1ad42575737b4f4 Aug 17 08:37:39.497753 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-VolumesNegativeTest-162882546-project Aug 17 08:37:39.497753 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Aug 17 08:37:39.497753 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1893692622", "metadata": {"Type": "work"}}} Aug 17 08:37:39.497753 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: Aug 17 08:37:39.497753 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 08:37:39.498549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1893692622', 'metadata': {'Type': 'work'}}}} Aug 17 08:37:39.498549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:37:39.498549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:37:39.498549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 08:37:39.498549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 08:37:39.498549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 08:37:39.498549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise error Aug 17 08:37:39.498549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 17 08:37:39.498549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:39.498549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 17 08:37:39.498549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 08:37:39.498549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:39.498549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 08:37:39.498549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi '0' Aug 17 08:37:39.498549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:39.498549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:37:39.498549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:39.498549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:37:39.498549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:37:39.498549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:37:39.498549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:37:39.498549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:37:39.499945 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 08:37:39.499945 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 08:37:39.499945 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:37:39.499945 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:37:39.499945 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 08:37:39.499945 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 08:37:39.499945 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 08:37:39.499945 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 08:37:39.499945 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 08:37:39.499945 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 08:37:39.499945 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 08:37:39.499945 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:39.499945 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:37:39.499945 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:39.499945 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:37:39.499945 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:37:39.499945 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:37:39.499945 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 08:37:39.499945 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 08:37:39.501098 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 08:37:39.501098 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:39.501098 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-081cf33c-f344-436d-bfe4-14227f68d01c tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:37:39.501098 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-081cf33c-f344-436d-bfe4-14227f68d01c tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.023050 Aug 17 08:37:39.507387 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 2/2] 10.222.0.15 () {60 vars in 1156 bytes} [Wed Aug 17 08:37:39 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 08:37:39.512234 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1b79a947-8e06-4288-8be1-ae20398da92f tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] Action: 'create', calling method: .version_select at 0x7f3f873d8e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-166258394", "metadata": {"Type": "work"}}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:37:39.515733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1b79a947-8e06-4288-8be1-ae20398da92f tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] Request method failure captured: Aug 17 08:37:39.515733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 08:37:39.515733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:37:39.515733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:37:39.515733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:37:39.515733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 118 Aug 17 08:37:39.515733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:37:39.515733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:37:39.515733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:37:39.515733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:37:39.515733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_KjRTn1lukoraNV38YuuOid8zEp1DIs5btpg5SEZD-vad9aDt1f3vsECwaRcAcJrb-dWbhxEoxW9NN93qZRcu5bqdEyS3788Oi1zh1Br1qyHIz6j5_XFNpbhUC_BQSqTNdJieyHPdOGPaZmAzEj8zttfBYJtzbUF9LRKnBFxW-diKdE Aug 17 08:37:39.515733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:37:39.515733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:37:39.515733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:37:39.515733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:37:39.515733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:37:39.515733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:37:39.515733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: 4a9a1d62cecd479e916fb67cf6d0d612 Aug 17 08:37:39.515733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-VolumesNegativeTest-162882546 Aug 17 08:37:39.515733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:37:39.515733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:37:39.517057 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4a9a1d62cecd479e916fb67cf6d0d612"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4a9a1d62cecd479e916fb67cf6d0d612"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4a9a1d62cecd479e916fb67cf6d0d612"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4a9a1d62cecd479e916fb67cf6d0d612", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:37:39.517057 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-VolumesNegativeTest-162882546 Aug 17 08:37:39.517057 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 4a9a1d62cecd479e916fb67cf6d0d612 Aug 17 08:37:39.517057 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-VolumesNegativeTest-162882546 Aug 17 08:37:39.517057 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-VolumesNegativeTest-162882546-project Aug 17 08:37:39.517057 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:37:39.517057 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:37:39.517057 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: 93b81cbad1554da3b1ad42575737b4f4 Aug 17 08:37:39.517057 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-VolumesNegativeTest-162882546-project Aug 17 08:37:39.517057 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Aug 17 08:37:39.517057 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-166258394", "metadata": {"Type": "work"}}} Aug 17 08:37:39.517057 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: Aug 17 08:37:39.517057 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 08:37:39.517892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-166258394', 'metadata': {'Type': 'work'}}}} Aug 17 08:37:39.517892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:37:39.517892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:37:39.517892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 08:37:39.517892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 08:37:39.517892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 08:37:39.517892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise error Aug 17 08:37:39.517892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 17 08:37:39.517892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:39.517892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 17 08:37:39.517892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 08:37:39.517892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:39.517892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 08:37:39.517892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi '' Aug 17 08:37:39.517892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:39.517892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:37:39.517892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:39.517892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:37:39.517892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:37:39.517892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:37:39.517892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:37:39.517892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:37:39.519302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 08:37:39.519302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 08:37:39.519302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:37:39.519302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:37:39.519302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 08:37:39.519302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 08:37:39.519302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 08:37:39.519302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 08:37:39.519302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 08:37:39.519302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 08:37:39.519302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 08:37:39.519302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:39.519302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:37:39.519302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:39.519302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:37:39.519302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:37:39.519302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:37:39.519302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 08:37:39.519302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 08:37:39.520457 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 08:37:39.520457 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:39.520457 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1b79a947-8e06-4288-8be1-ae20398da92f tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:37:39.520457 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1b79a947-8e06-4288-8be1-ae20398da92f tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008549 Aug 17 08:37:39.520457 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 3/3] 10.222.0.15 () {60 vars in 1156 bytes} [Wed Aug 17 08:37:39 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 08:37:39.529791 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1571cd1e-f4a1-40a1-98b7-b19f3b835b01 tempest-VolumesGetTestJSON-1890975318 tempest-VolumesGetTestJSON-1890975318-project] Action: 'create', calling method: .version_select at 0x7f3f8748d280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-637040109", "metadata": {"Type": "work"}}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:37:39.536723 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-75e54772-46af-4b28-889c-c03922b9f249 tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] Calling method '.version_select at 0x7f3f8748e4c0>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:37:40.236680 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-75e54772-46af-4b28-889c-c03922b9f249 tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] HTTP exception thrown: Volume tempest-invalid-1252836579 could not be found. Aug 17 08:37:40.241610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-75e54772-46af-4b28-889c-c03922b9f249 tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] Request method failure captured: Aug 17 08:37:40.241610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1252836579 HTTP/1.1 Aug 17 08:37:40.241610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:37:40.241610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:37:40.241610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:37:40.241610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:37:40.241610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:37:40.241610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:37:40.241610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:37:40.241610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:37:40.241610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_KjRTn1lukoraNV38YuuOid8zEp1DIs5btpg5SEZD-vad9aDt1f3vsECwaRcAcJrb-dWbhxEoxW9NN93qZRcu5bqdEyS3788Oi1zh1Br1qyHIz6j5_XFNpbhUC_BQSqTNdJieyHPdOGPaZmAzEj8zttfBYJtzbUF9LRKnBFxW-diKdE Aug 17 08:37:40.241610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:37:40.241610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:37:40.241610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:37:40.241610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:37:40.241610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:37:40.241610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:37:40.241610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: 4a9a1d62cecd479e916fb67cf6d0d612 Aug 17 08:37:40.241610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-VolumesNegativeTest-162882546 Aug 17 08:37:40.241610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:37:40.241610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:37:40.243178 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4a9a1d62cecd479e916fb67cf6d0d612"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4a9a1d62cecd479e916fb67cf6d0d612"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4a9a1d62cecd479e916fb67cf6d0d612"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4a9a1d62cecd479e916fb67cf6d0d612", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:37:40.243178 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-VolumesNegativeTest-162882546 Aug 17 08:37:40.243178 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 4a9a1d62cecd479e916fb67cf6d0d612 Aug 17 08:37:40.243178 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-VolumesNegativeTest-162882546 Aug 17 08:37:40.243178 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-VolumesNegativeTest-162882546-project Aug 17 08:37:40.243178 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:37:40.243178 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:37:40.243178 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: 93b81cbad1554da3b1ad42575737b4f4 Aug 17 08:37:40.243178 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-VolumesNegativeTest-162882546-project Aug 17 08:37:40.243178 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: Aug 17 08:37:40.243178 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Volume tempest-invalid-1252836579 could not be found. Aug 17 08:37:40.243178 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': 'tempest-invalid-1252836579'} Aug 17 08:37:40.243178 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:37:40.244075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:37:40.244075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 08:37:40.244075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 08:37:40.244075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 08:37:40.244075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 08:37:40.244075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 08:37:40.244075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 08:37:40.244075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 08:37:40.244075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 08:37:40.244075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 08:37:40.244075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 08:37:40.244075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 08:37:40.244075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 08:37:40.244075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 08:37:40.244075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 08:37:40.244075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1252836579 could not be found. (HTTP 404) (Request-ID: req-9a8b62c6-008c-4f65-b23d-96a51525dbcc) Aug 17 08:37:40.244075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:40.244075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:37:40.244075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:40.245293 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:37:40.245293 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 08:37:40.245293 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 08:37:40.245293 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 08:37:40.245293 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 08:37:40.245293 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 08:37:40.245293 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 08:37:40.245293 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 08:37:40.245293 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 08:37:40.245293 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 08:37:40.245293 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 08:37:40.245293 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 08:37:40.245293 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 08:37:40.245293 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 08:37:40.245293 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 08:37:40.245293 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 08:37:40.245293 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 08:37:40.245293 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 08:37:40.245293 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 08:37:40.246643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 08:37:40.246643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 08:37:40.246643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 08:37:40.246643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 08:37:40.246643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1252836579 could not be found. Aug 17 08:37:40.246643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:40.246643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:37:40.246643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:40.246643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:37:40.246643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:37:40.246643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:37:40.246643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:37:40.246643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:37:40.246643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 08:37:40.246643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 08:37:40.246643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:37:40.246643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:37:40.246643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 08:37:40.246643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:37:40.246643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1252836579 could not be found. Aug 17 08:37:40.248303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:40.248303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:37:40.248303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:40.248303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:37:40.248303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:37:40.248303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:37:40.248303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:37:40.248303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:37:40.248303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1252836579 could not be found. Aug 17 08:37:40.248303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:40.248303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-75e54772-46af-4b28-889c-c03922b9f249 tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] Returning 404 to user: Volume tempest-invalid-1252836579 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:37:40.248303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-75e54772-46af-4b28-889c-c03922b9f249 tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1252836579" status: 404 len: 99 microversion: 2.1 time: 0.712491 Aug 17 08:37:40.248303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 4/4] 10.222.0.15 () {58 vars in 1218 bytes} [Wed Aug 17 08:37:39 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1252836579 => generated 99 bytes in 714 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 17 08:37:40.259667 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b95c758d-abf3-4047-8bf3-f565990c1d5e tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006636 Aug 17 08:37:40.263507 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 5/5] 10.222.0.15 () {58 vars in 1140 bytes} [Wed Aug 17 08:37:40 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 17 08:37:40.277992 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4b86355d-38bc-4c6c-ae6c-59d4fd3f7efe tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007464 Aug 17 08:37:40.278855 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 6/6] 10.222.0.15 () {58 vars in 1137 bytes} [Wed Aug 17 08:37:40 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 17 08:37:40.295962 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2805b638-5e9b-4696-87c3-52f00c94de31 tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] Calling method '.version_select at 0x7f3f87275160>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:37:40.912928 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-2805b638-5e9b-4696-87c3-52f00c94de31 tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] HTTP exception thrown: Volume 5534109e-6091-495b-9134-da1d1ef4cb0d could not be found. Aug 17 08:37:40.916736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2805b638-5e9b-4696-87c3-52f00c94de31 tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] Request method failure captured: Aug 17 08:37:40.916736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: DELETE /compute/v2.1/os-volumes/5534109e-6091-495b-9134-da1d1ef4cb0d HTTP/1.1 Aug 17 08:37:40.916736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:37:40.916736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:37:40.916736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:37:40.916736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:37:40.916736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:37:40.916736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:37:40.916736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:37:40.916736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:37:40.916736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_KjRTn1lukoraNV38YuuOid8zEp1DIs5btpg5SEZD-vad9aDt1f3vsECwaRcAcJrb-dWbhxEoxW9NN93qZRcu5bqdEyS3788Oi1zh1Br1qyHIz6j5_XFNpbhUC_BQSqTNdJieyHPdOGPaZmAzEj8zttfBYJtzbUF9LRKnBFxW-diKdE Aug 17 08:37:40.916736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:37:40.916736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:37:40.916736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:37:40.916736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:37:40.916736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:37:40.916736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:37:40.916736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: 4a9a1d62cecd479e916fb67cf6d0d612 Aug 17 08:37:40.916736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-VolumesNegativeTest-162882546 Aug 17 08:37:40.916736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:37:40.916736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:37:40.918124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4a9a1d62cecd479e916fb67cf6d0d612"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4a9a1d62cecd479e916fb67cf6d0d612"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4a9a1d62cecd479e916fb67cf6d0d612"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4a9a1d62cecd479e916fb67cf6d0d612", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:37:40.918124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-VolumesNegativeTest-162882546 Aug 17 08:37:40.918124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 4a9a1d62cecd479e916fb67cf6d0d612 Aug 17 08:37:40.918124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-VolumesNegativeTest-162882546 Aug 17 08:37:40.918124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-VolumesNegativeTest-162882546-project Aug 17 08:37:40.918124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:37:40.918124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:37:40.918124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: 93b81cbad1554da3b1ad42575737b4f4 Aug 17 08:37:40.918124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-VolumesNegativeTest-162882546-project Aug 17 08:37:40.918124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: Aug 17 08:37:40.918124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Volume 5534109e-6091-495b-9134-da1d1ef4cb0d could not be found. Aug 17 08:37:40.918124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': '5534109e-6091-495b-9134-da1d1ef4cb0d'} Aug 17 08:37:40.918124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:37:40.918919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:37:40.918919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 08:37:40.918919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 08:37:40.918919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 08:37:40.918919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 08:37:40.918919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 08:37:40.918919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 08:37:40.918919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 08:37:40.918919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 08:37:40.918919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 08:37:40.918919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 08:37:40.918919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 08:37:40.918919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 08:37:40.918919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 08:37:40.918919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 08:37:40.918919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5534109e-6091-495b-9134-da1d1ef4cb0d could not be found. (HTTP 404) (Request-ID: req-78fc5bad-4afe-42ca-9e28-23bc3b06a718) Aug 17 08:37:40.918919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:40.918919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:37:40.918919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:40.920786 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:37:40.920786 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 08:37:40.920786 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 08:37:40.920786 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 08:37:40.920786 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 08:37:40.920786 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 08:37:40.920786 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 08:37:40.920786 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 08:37:40.920786 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 08:37:40.920786 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 08:37:40.920786 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 08:37:40.920786 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 08:37:40.920786 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 08:37:40.920786 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 08:37:40.920786 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 08:37:40.920786 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 08:37:40.920786 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 08:37:40.920786 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 08:37:40.920786 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 08:37:40.922718 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 08:37:40.922718 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 08:37:40.922718 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 08:37:40.922718 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 08:37:40.922718 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5534109e-6091-495b-9134-da1d1ef4cb0d could not be found. Aug 17 08:37:40.922718 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:40.922718 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:37:40.922718 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:40.922718 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:37:40.922718 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:37:40.922718 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:37:40.922718 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:37:40.922718 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:37:40.922718 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 08:37:40.922718 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 08:37:40.922718 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:37:40.922718 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:37:40.922718 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 08:37:40.922718 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:37:40.925942 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5534109e-6091-495b-9134-da1d1ef4cb0d could not be found. Aug 17 08:37:40.925942 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:40.925942 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:37:40.925942 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:40.925942 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:37:40.925942 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:37:40.925942 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:37:40.925942 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:37:40.925942 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:37:40.925942 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5534109e-6091-495b-9134-da1d1ef4cb0d could not be found. Aug 17 08:37:40.925942 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:40.929411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2805b638-5e9b-4696-87c3-52f00c94de31 tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] Returning 404 to user: Volume 5534109e-6091-495b-9134-da1d1ef4cb0d could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:37:40.931201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2805b638-5e9b-4696-87c3-52f00c94de31 tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/5534109e-6091-495b-9134-da1d1ef4cb0d" status: 404 len: 109 microversion: 2.1 time: 0.642627 Aug 17 08:37:40.933204 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 7/7] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 08:37:40 2022] DELETE /compute/v2.1/os-volumes/5534109e-6091-495b-9134-da1d1ef4cb0d => generated 109 bytes in 645 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:37:40.946823 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-487d9c42-615f-49ea-a825-db71d1723333 tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] Calling method '.version_select at 0x7f3f872751f0>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:37:41.304792 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1571cd1e-f4a1-40a1-98b7-b19f3b835b01 tempest-VolumesGetTestJSON-1890975318 tempest-VolumesGetTestJSON-1890975318-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.177605 Aug 17 08:37:41.314548 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 1/8] 10.222.0.15 () {60 vars in 1156 bytes} [Wed Aug 17 08:37:38 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3189 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 17 08:37:41.321116 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-82343eda-ad17-4dae-8d8c-8dde33aac80c tempest-VolumesGetTestJSON-1890975318 tempest-VolumesGetTestJSON-1890975318-project] Calling method '.version_select at 0x7f3f872ed160>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:37:41.352216 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-487d9c42-615f-49ea-a825-db71d1723333 tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] HTTP exception thrown: Volume 5dbd4423-a5e9-4fc6-8a49-e5f5c9b50536 could not be found. Aug 17 08:37:41.354136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-487d9c42-615f-49ea-a825-db71d1723333 tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] Request method failure captured: Aug 17 08:37:41.354136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/os-volumes/5dbd4423-a5e9-4fc6-8a49-e5f5c9b50536 HTTP/1.1 Aug 17 08:37:41.354136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:37:41.354136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:37:41.354136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:37:41.354136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:37:41.354136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:37:41.354136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:37:41.354136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:37:41.354136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:37:41.354136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_KjRTn1lukoraNV38YuuOid8zEp1DIs5btpg5SEZD-vad9aDt1f3vsECwaRcAcJrb-dWbhxEoxW9NN93qZRcu5bqdEyS3788Oi1zh1Br1qyHIz6j5_XFNpbhUC_BQSqTNdJieyHPdOGPaZmAzEj8zttfBYJtzbUF9LRKnBFxW-diKdE Aug 17 08:37:41.354136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:37:41.354136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:37:41.354136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:37:41.354136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:37:41.354136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:37:41.354136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:37:41.354136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: 4a9a1d62cecd479e916fb67cf6d0d612 Aug 17 08:37:41.354136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-VolumesNegativeTest-162882546 Aug 17 08:37:41.354136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:37:41.354136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:37:41.355401 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4a9a1d62cecd479e916fb67cf6d0d612"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4a9a1d62cecd479e916fb67cf6d0d612"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4a9a1d62cecd479e916fb67cf6d0d612"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4a9a1d62cecd479e916fb67cf6d0d612", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:37:41.355401 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-VolumesNegativeTest-162882546 Aug 17 08:37:41.355401 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 4a9a1d62cecd479e916fb67cf6d0d612 Aug 17 08:37:41.355401 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-VolumesNegativeTest-162882546 Aug 17 08:37:41.355401 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-VolumesNegativeTest-162882546-project Aug 17 08:37:41.355401 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:37:41.355401 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:37:41.355401 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: 93b81cbad1554da3b1ad42575737b4f4 Aug 17 08:37:41.355401 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-VolumesNegativeTest-162882546-project Aug 17 08:37:41.355401 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: Aug 17 08:37:41.355401 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Volume 5dbd4423-a5e9-4fc6-8a49-e5f5c9b50536 could not be found. Aug 17 08:37:41.355401 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': '5dbd4423-a5e9-4fc6-8a49-e5f5c9b50536'} Aug 17 08:37:41.355401 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:37:41.356270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:37:41.356270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 08:37:41.356270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 08:37:41.356270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 08:37:41.356270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 08:37:41.356270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 08:37:41.356270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 08:37:41.356270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 08:37:41.356270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 08:37:41.356270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 08:37:41.356270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 08:37:41.356270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 08:37:41.356270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 08:37:41.356270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 08:37:41.356270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 08:37:41.356270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5dbd4423-a5e9-4fc6-8a49-e5f5c9b50536 could not be found. (HTTP 404) (Request-ID: req-e6e15798-78a0-424b-9ca4-08fe5027fb62) Aug 17 08:37:41.356270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:41.356270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:37:41.356270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:41.357411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:37:41.357411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 08:37:41.357411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 08:37:41.357411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 08:37:41.357411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 08:37:41.357411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 08:37:41.357411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 08:37:41.357411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 08:37:41.357411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 08:37:41.357411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 08:37:41.357411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 08:37:41.357411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 08:37:41.357411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 08:37:41.357411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 08:37:41.357411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 08:37:41.357411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 08:37:41.357411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 08:37:41.357411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 08:37:41.357411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 08:37:41.358543 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 08:37:41.358543 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 08:37:41.358543 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 08:37:41.358543 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 08:37:41.358543 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5dbd4423-a5e9-4fc6-8a49-e5f5c9b50536 could not be found. Aug 17 08:37:41.358543 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:41.358543 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:37:41.358543 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:41.358543 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:37:41.358543 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:37:41.358543 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:37:41.358543 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:37:41.358543 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:37:41.358543 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 08:37:41.358543 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 08:37:41.358543 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:37:41.358543 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:37:41.358543 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 08:37:41.358543 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:37:41.359697 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5dbd4423-a5e9-4fc6-8a49-e5f5c9b50536 could not be found. Aug 17 08:37:41.359697 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:41.359697 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:37:41.359697 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:41.359697 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:37:41.359697 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:37:41.359697 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:37:41.359697 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:37:41.359697 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:37:41.359697 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5dbd4423-a5e9-4fc6-8a49-e5f5c9b50536 could not be found. Aug 17 08:37:41.359697 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:41.359697 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-487d9c42-615f-49ea-a825-db71d1723333 tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] Returning 404 to user: Volume 5dbd4423-a5e9-4fc6-8a49-e5f5c9b50536 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:37:41.359697 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-487d9c42-615f-49ea-a825-db71d1723333 tempest-VolumesNegativeTest-162882546 tempest-VolumesNegativeTest-162882546-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/5dbd4423-a5e9-4fc6-8a49-e5f5c9b50536" status: 404 len: 109 microversion: 2.1 time: 0.416100 Aug 17 08:37:41.359697 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 8/9] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 08:37:40 2022] GET /compute/v2.1/os-volumes/5dbd4423-a5e9-4fc6-8a49-e5f5c9b50536 => generated 109 bytes in 417 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:37:41.525960 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-82343eda-ad17-4dae-8d8c-8dde33aac80c tempest-VolumesGetTestJSON-1890975318 tempest-VolumesGetTestJSON-1890975318-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/322bd516-8439-4bba-99ce-4c195a6155a6" status: 200 len: 352 microversion: 2.1 time: 0.209880 Aug 17 08:37:41.527718 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 2/10] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 08:37:41 2022] GET /compute/v2.1/os-volumes/322bd516-8439-4bba-99ce-4c195a6155a6 => generated 352 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:37:42.540661 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-cf955438-b651-49cc-8248-17ac5a0c11e2 tempest-VolumesGetTestJSON-1890975318 tempest-VolumesGetTestJSON-1890975318-project] Calling method '.version_select at 0x7f3f87552c10>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:37:43.207437 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-cf955438-b651-49cc-8248-17ac5a0c11e2 tempest-VolumesGetTestJSON-1890975318 tempest-VolumesGetTestJSON-1890975318-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/322bd516-8439-4bba-99ce-4c195a6155a6" status: 200 len: 353 microversion: 2.1 time: 0.671142 Aug 17 08:37:43.209120 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 9/11] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 08:37:42 2022] GET /compute/v2.1/os-volumes/322bd516-8439-4bba-99ce-4c195a6155a6 => generated 353 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:37:43.240071 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-708a2760-a675-44ea-a3ac-fa3b53ebb220 tempest-VolumesGetTestJSON-1890975318 tempest-VolumesGetTestJSON-1890975318-project] Calling method '.version_select at 0x7f3f872ed8b0>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:37:43.558990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-708a2760-a675-44ea-a3ac-fa3b53ebb220 tempest-VolumesGetTestJSON-1890975318 tempest-VolumesGetTestJSON-1890975318-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/322bd516-8439-4bba-99ce-4c195a6155a6" status: 200 len: 353 microversion: 2.1 time: 0.340573 Aug 17 08:37:43.559758 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 3/12] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 08:37:43 2022] GET /compute/v2.1/os-volumes/322bd516-8439-4bba-99ce-4c195a6155a6 => generated 353 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:37:43.580450 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-23110c38-bc66-4602-a1d3-2be8d21f02a6 tempest-VolumesGetTestJSON-1890975318 tempest-VolumesGetTestJSON-1890975318-project] Calling method '.version_select at 0x7f3f87256ee0>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:37:43.759948 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-23110c38-bc66-4602-a1d3-2be8d21f02a6 tempest-VolumesGetTestJSON-1890975318 tempest-VolumesGetTestJSON-1890975318-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/322bd516-8439-4bba-99ce-4c195a6155a6" status: 202 len: 0 microversion: 2.1 time: 0.183662 Aug 17 08:37:43.760725 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 10/13] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 08:37:43 2022] DELETE /compute/v2.1/os-volumes/322bd516-8439-4bba-99ce-4c195a6155a6 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:37:43.769872 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-50e596d6-89f2-49b9-bed9-b3089b368f64 tempest-VolumesGetTestJSON-1890975318 tempest-VolumesGetTestJSON-1890975318-project] Calling method '.version_select at 0x7f3f872edf70>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:37:43.907138 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-50e596d6-89f2-49b9-bed9-b3089b368f64 tempest-VolumesGetTestJSON-1890975318 tempest-VolumesGetTestJSON-1890975318-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/322bd516-8439-4bba-99ce-4c195a6155a6" status: 200 len: 352 microversion: 2.1 time: 0.141765 Aug 17 08:37:43.914117 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 4/14] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 08:37:43 2022] GET /compute/v2.1/os-volumes/322bd516-8439-4bba-99ce-4c195a6155a6 => generated 352 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:37:44.921413 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-901d8348-edaf-40eb-b3c6-cbd97d401ec0 tempest-VolumesGetTestJSON-1890975318 tempest-VolumesGetTestJSON-1890975318-project] Calling method '.version_select at 0x7f3f87275310>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:37:44.984379 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-901d8348-edaf-40eb-b3c6-cbd97d401ec0 tempest-VolumesGetTestJSON-1890975318 tempest-VolumesGetTestJSON-1890975318-project] HTTP exception thrown: Volume 322bd516-8439-4bba-99ce-4c195a6155a6 could not be found. Aug 17 08:37:44.987432 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-901d8348-edaf-40eb-b3c6-cbd97d401ec0 tempest-VolumesGetTestJSON-1890975318 tempest-VolumesGetTestJSON-1890975318-project] Request method failure captured: Aug 17 08:37:44.987432 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/os-volumes/322bd516-8439-4bba-99ce-4c195a6155a6 HTTP/1.1 Aug 17 08:37:44.987432 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:37:44.987432 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:37:44.987432 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:37:44.987432 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:37:44.987432 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:37:44.987432 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:37:44.987432 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:37:44.987432 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:37:44.987432 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_KjSVjILhpe00_5-4xP7RKz5mFwO-ZzR7JwJcadbYPtRTczcNmMzIRfzelmxcWeUhhmPbXnl59aQkL6lukzsTH0ns7j1grP0GmmH0bSVdVI65Z4xqAnuFvR7B3fAT85n6qy0MpuC2XRGIDnr5yrfMFQbdpjAM5pjsKFvHQKHjZ1rTWM Aug 17 08:37:44.987432 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:37:44.987432 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:37:44.987432 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:37:44.987432 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:37:44.987432 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:37:44.987432 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:37:44.987432 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: aec3a96984084453b5e3e7f3e826f694 Aug 17 08:37:44.987432 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-VolumesGetTestJSON-1890975318 Aug 17 08:37:44.987432 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:37:44.987432 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:37:44.988525 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/aec3a96984084453b5e3e7f3e826f694"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/aec3a96984084453b5e3e7f3e826f694"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/aec3a96984084453b5e3e7f3e826f694"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_aec3a96984084453b5e3e7f3e826f694", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:37:44.988525 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-VolumesGetTestJSON-1890975318 Aug 17 08:37:44.988525 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: aec3a96984084453b5e3e7f3e826f694 Aug 17 08:37:44.988525 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-VolumesGetTestJSON-1890975318 Aug 17 08:37:44.988525 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-VolumesGetTestJSON-1890975318-project Aug 17 08:37:44.988525 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:37:44.988525 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:37:44.988525 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: d6bdc20813694b0db5ca39069974b036 Aug 17 08:37:44.988525 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-VolumesGetTestJSON-1890975318-project Aug 17 08:37:44.988525 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: Aug 17 08:37:44.988525 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Volume 322bd516-8439-4bba-99ce-4c195a6155a6 could not be found. Aug 17 08:37:44.988525 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': '322bd516-8439-4bba-99ce-4c195a6155a6'} Aug 17 08:37:44.988525 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:37:44.989303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:37:44.989303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 08:37:44.989303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 08:37:44.989303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 08:37:44.989303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 08:37:44.989303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 08:37:44.989303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 08:37:44.989303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 08:37:44.989303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 08:37:44.989303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 08:37:44.989303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 08:37:44.989303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 08:37:44.989303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 08:37:44.989303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 08:37:44.989303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 08:37:44.989303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 322bd516-8439-4bba-99ce-4c195a6155a6 could not be found. (HTTP 404) (Request-ID: req-6acb33b1-c69c-494b-b0cc-c9b23ab7c1ac) Aug 17 08:37:44.989303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:44.989303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:37:44.989303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:44.990197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:37:44.990197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 08:37:44.990197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 08:37:44.990197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 08:37:44.990197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 08:37:44.990197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 08:37:44.990197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 08:37:44.990197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 08:37:44.990197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 08:37:44.990197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 08:37:44.990197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 08:37:44.990197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 08:37:44.990197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 08:37:44.990197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 08:37:44.990197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 08:37:44.990197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 08:37:44.990197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 08:37:44.990197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 08:37:44.990197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 08:37:44.991071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 08:37:44.991071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 08:37:44.991071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 08:37:44.991071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 08:37:44.991071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 322bd516-8439-4bba-99ce-4c195a6155a6 could not be found. Aug 17 08:37:44.991071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:44.991071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:37:44.991071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:44.991071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:37:44.991071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:37:44.991071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:37:44.991071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:37:44.991071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:37:44.991071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 08:37:44.991071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 08:37:44.991071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:37:44.991071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:37:44.991071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 08:37:44.991071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:37:44.992038 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 322bd516-8439-4bba-99ce-4c195a6155a6 could not be found. Aug 17 08:37:44.992038 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:44.992038 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:37:44.992038 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:44.992038 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:37:44.992038 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:37:44.992038 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:37:44.992038 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:37:44.992038 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:37:44.992038 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 322bd516-8439-4bba-99ce-4c195a6155a6 could not be found. Aug 17 08:37:44.992038 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:37:44.995505 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-901d8348-edaf-40eb-b3c6-cbd97d401ec0 tempest-VolumesGetTestJSON-1890975318 tempest-VolumesGetTestJSON-1890975318-project] Returning 404 to user: Volume 322bd516-8439-4bba-99ce-4c195a6155a6 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:37:44.996541 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-901d8348-edaf-40eb-b3c6-cbd97d401ec0 tempest-VolumesGetTestJSON-1890975318 tempest-VolumesGetTestJSON-1890975318-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/322bd516-8439-4bba-99ce-4c195a6155a6" status: 404 len: 109 microversion: 2.1 time: 0.079052 Aug 17 08:37:44.997282 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 11/15] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 08:37:44 2022] GET /compute/v2.1/os-volumes/322bd516-8439-4bba-99ce-4c195a6155a6 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:37:54.448311 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a96a73a1-6312-46fb-a3d3-8293550b1733 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Action: 'create', calling method: .version_select at 0x7f3f872eddc0>, body: {"keypair": {"name": "tempest-keypair-374040571", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgWJKqXRA3BWEDnZPwf572sEzvkOEgQPsmco9oKZRvBbSN4UWHGzQOgiwnQuZxUG3cu0ChsPFmUQNbPp6T6ZfWS8AvE6+vu7JJL6mJA1WbwJ8sWIUHVtMCl5AanX/mlsg=="}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:37:54.502830 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e6704195-5c5c-4af6-9e0c-73442a6dc31e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-511515189", "imageRef": "4467450c-a35c-42e3-af85-a13291b0b2aa", "flavorRef": "452", "networks": [{"uuid": "e45ace09-2742-4d01-b1e6-2e72d8cdfa09"}]}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:37:54.642109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-a96a73a1-6312-46fb-a3d3-8293550b1733 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Getting quotas for project 458a894213fa47d78568eefbb75f05b3. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:37:54.659684 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-a96a73a1-6312-46fb-a3d3-8293550b1733 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Getting quotas for user d0aea5553e1043889571c50c3b01cacc and project 458a894213fa47d78568eefbb75f05b3. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:37:54.765408 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.network.neutron [None req-e6704195-5c5c-4af6-9e0c-73442a6dc31e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] validate_networks() for [('e45ace09-2742-4d01-b1e6-2e72d8cdfa09', None, None, None, None, None)] {{(pid=127297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 08:37:54.822866 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a96a73a1-6312-46fb-a3d3-8293550b1733 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.600664 Aug 17 08:37:54.825262 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 5/16] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 08:37:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:37:54.994103 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-29cee15f-0dc9-4bb8-b891-e8d496b1572e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1766621907", "imageRef": "4467450c-a35c-42e3-af85-a13291b0b2aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:37:55.218669 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.network.neutron [None req-29cee15f-0dc9-4bb8-b891-e8d496b1572e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] validate_networks() for [('f99d5d5e-b854-44c4-b2ed-25a3534627e4', None, None, None, None, None)] {{(pid=127298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 08:37:56.814158 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-e6704195-5c5c-4af6-9e0c-73442a6dc31e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Flavor limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 08:37:56.814713 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-e6704195-5c5c-4af6-9e0c-73442a6dc31e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Image limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 08:37:56.815074 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-e6704195-5c5c-4af6-9e0c-73442a6dc31e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Flavor pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 08:37:56.815874 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-e6704195-5c5c-4af6-9e0c-73442a6dc31e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Image pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 08:37:56.816170 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-e6704195-5c5c-4af6-9e0c-73442a6dc31e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 08:37:56.852235 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e6704195-5c5c-4af6-9e0c-73442a6dc31e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:37:56.853036 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e6704195-5c5c-4af6-9e0c-73442a6dc31e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:37:56.854562 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e6704195-5c5c-4af6-9e0c-73442a6dc31e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:37:56.860035 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e6704195-5c5c-4af6-9e0c-73442a6dc31e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:37:56.861955 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e6704195-5c5c-4af6-9e0c-73442a6dc31e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:37:56.862609 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e6704195-5c5c-4af6-9e0c-73442a6dc31e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:37:56.965784 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-e6704195-5c5c-4af6-9e0c-73442a6dc31e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Getting quotas for project db908214d6fb40909a4728b207bf776a. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:37:56.973675 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-29cee15f-0dc9-4bb8-b891-e8d496b1572e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Flavor limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 08:37:56.974531 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-29cee15f-0dc9-4bb8-b891-e8d496b1572e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Image limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 08:37:56.975063 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-29cee15f-0dc9-4bb8-b891-e8d496b1572e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Flavor pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 08:37:56.975690 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-29cee15f-0dc9-4bb8-b891-e8d496b1572e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Image pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 08:37:56.981830 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-29cee15f-0dc9-4bb8-b891-e8d496b1572e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 08:37:57.013994 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-29cee15f-0dc9-4bb8-b891-e8d496b1572e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:37:57.014805 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-e6704195-5c5c-4af6-9e0c-73442a6dc31e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Getting quotas for user 51def7315f294e99ba206f5db1ef282f and project db908214d6fb40909a4728b207bf776a. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:37:57.015410 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-29cee15f-0dc9-4bb8-b891-e8d496b1572e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:37:57.019699 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-29cee15f-0dc9-4bb8-b891-e8d496b1572e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:37:57.022998 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-29cee15f-0dc9-4bb8-b891-e8d496b1572e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:37:57.029660 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-29cee15f-0dc9-4bb8-b891-e8d496b1572e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:37:57.035520 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-29cee15f-0dc9-4bb8-b891-e8d496b1572e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:37:57.070824 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e6704195-5c5c-4af6-9e0c-73442a6dc31e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Going to run 1 instances... {{(pid=127297) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 08:37:57.080939 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e6704195-5c5c-4af6-9e0c-73442a6dc31e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4467450c-a35c-42e3-af85-a13291b0b2aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 08:37:57.137426 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-29cee15f-0dc9-4bb8-b891-e8d496b1572e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Getting quotas for project 2f3596b4a1404d3db340943fbd63567d. Resources: {'cores', 'instances', 'ram'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:37:57.156517 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-29cee15f-0dc9-4bb8-b891-e8d496b1572e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Getting quotas for user f051f99404fc4e0593553ae95e1f90d5 and project 2f3596b4a1404d3db340943fbd63567d. Resources: {'cores', 'instances', 'ram'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:37:57.208217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-29cee15f-0dc9-4bb8-b891-e8d496b1572e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Going to run 1 instances... {{(pid=127298) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 08:37:57.215309 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-29cee15f-0dc9-4bb8-b891-e8d496b1572e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4467450c-a35c-42e3-af85-a13291b0b2aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 08:37:57.336506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e6704195-5c5c-4af6-9e0c-73442a6dc31e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.046577 Aug 17 08:37:57.337224 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 12/17] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 08:37:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 08:37:57.352096 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2b6b8725-fbd2-4e14-a5cb-216ebe1de517 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:37:57.354687 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-2b6b8725-fbd2-4e14-a5cb-216ebe1de517 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:37:57.417637 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-29cee15f-0dc9-4bb8-b891-e8d496b1572e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.590600 Aug 17 08:37:57.420375 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 6/18] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 08:37:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 2593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 08:37:57.439927 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-11f7906e-6369-4023-b695-99c4dc08a201 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:37:57.446270 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-11f7906e-6369-4023-b695-99c4dc08a201 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:37:57.663370 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-2b6b8725-fbd2-4e14-a5cb-216ebe1de517 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:37:57.726278 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2b6b8725-fbd2-4e14-a5cb-216ebe1de517 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1214 microversion: 2.1 time: 0.376842 Aug 17 08:37:57.729082 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 13/19] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:37:57 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1214 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:37:57.932276 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-11f7906e-6369-4023-b695-99c4dc08a201 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:37:57.969024 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-11f7906e-6369-4023-b695-99c4dc08a201 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1222 microversion: 2.1 time: 0.542134 Aug 17 08:37:57.970284 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 7/20] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:37:57 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1222 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:37:58.189948 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c5956bd7-ded3-47c8-9b21-7de9df91ea49 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-34192162", "imageRef": "4467450c-a35c-42e3-af85-a13291b0b2aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:37:58.349067 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.network.neutron [None req-c5956bd7-ded3-47c8-9b21-7de9df91ea49 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] validate_networks() for [('f99d5d5e-b854-44c4-b2ed-25a3534627e4', None, None, None, None, None)] {{(pid=127297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 08:37:58.755641 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-aa7786aa-f18e-4646-9d12-8c0fff9356cd tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:37:58.757806 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-aa7786aa-f18e-4646-9d12-8c0fff9356cd tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:37:59.044424 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-aa7786aa-f18e-4646-9d12-8c0fff9356cd tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:37:59.065499 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-aa7786aa-f18e-4646-9d12-8c0fff9356cd tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1214 microversion: 2.1 time: 0.317187 Aug 17 08:37:59.071474 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 8/21] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:37:58 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1214 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:37:59.111783 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d2094419-8e2e-4b3d-9a55-aa19311908d5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1416346727", "imageRef": "4467450c-a35c-42e3-af85-a13291b0b2aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c245bd1-04fc-4f54-88af-8bb12d32f7ee"}], "security_groups": [{"name": "tempest-securitygroup--211883562"}], "key_name": "tempest-keypair-374040571", "user_data": "}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:37:59.639248 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-c5956bd7-ded3-47c8-9b21-7de9df91ea49 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Flavor limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 08:37:59.640431 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-c5956bd7-ded3-47c8-9b21-7de9df91ea49 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Image limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 08:37:59.645758 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-c5956bd7-ded3-47c8-9b21-7de9df91ea49 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Flavor pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 08:37:59.648022 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-c5956bd7-ded3-47c8-9b21-7de9df91ea49 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Image pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 08:37:59.650140 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-c5956bd7-ded3-47c8-9b21-7de9df91ea49 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 08:37:59.674558 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c5956bd7-ded3-47c8-9b21-7de9df91ea49 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:37:59.677288 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c5956bd7-ded3-47c8-9b21-7de9df91ea49 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:37:59.677993 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c5956bd7-ded3-47c8-9b21-7de9df91ea49 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:37:59.680692 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c5956bd7-ded3-47c8-9b21-7de9df91ea49 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:37:59.681169 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c5956bd7-ded3-47c8-9b21-7de9df91ea49 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:37:59.682748 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c5956bd7-ded3-47c8-9b21-7de9df91ea49 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:37:59.708284 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-c5956bd7-ded3-47c8-9b21-7de9df91ea49 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Getting quotas for project 2f3596b4a1404d3db340943fbd63567d. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:37:59.716268 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-c5956bd7-ded3-47c8-9b21-7de9df91ea49 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Getting quotas for user f051f99404fc4e0593553ae95e1f90d5 and project 2f3596b4a1404d3db340943fbd63567d. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:37:59.757232 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c5956bd7-ded3-47c8-9b21-7de9df91ea49 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Going to run 1 instances... {{(pid=127297) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 08:37:59.759781 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c5956bd7-ded3-47c8-9b21-7de9df91ea49 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4467450c-a35c-42e3-af85-a13291b0b2aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 08:37:59.824443 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.network.neutron [None req-d2094419-8e2e-4b3d-9a55-aa19311908d5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] validate_networks() for [('8c245bd1-04fc-4f54-88af-8bb12d32f7ee', None, None, None, None, None)] {{(pid=127298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 08:37:59.925434 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c5956bd7-ded3-47c8-9b21-7de9df91ea49 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.740418 Aug 17 08:37:59.932171 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 14/22] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 08:37:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 08:37:59.965719 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-696fa53a-fd08-4345-98b6-091ac4efeb84 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:37:59.966985 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-696fa53a-fd08-4345-98b6-091ac4efeb84 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:00.103829 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-696fa53a-fd08-4345-98b6-091ac4efeb84 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:00.113216 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-696fa53a-fd08-4345-98b6-091ac4efeb84 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1220 microversion: 2.1 time: 0.179722 Aug 17 08:38:00.113850 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 15/23] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:37:59 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1220 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:00.134386 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-93ec2669-4d10-485b-82ac-ee2757a931fe tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:00.135499 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-93ec2669-4d10-485b-82ac-ee2757a931fe tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:00.149263 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-93ec2669-4d10-485b-82ac-ee2757a931fe tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:00.150557 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-93ec2669-4d10-485b-82ac-ee2757a931fe tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:00.152446 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-93ec2669-4d10-485b-82ac-ee2757a931fe tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:00.153555 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-93ec2669-4d10-485b-82ac-ee2757a931fe tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:00.155427 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-93ec2669-4d10-485b-82ac-ee2757a931fe tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:00.157036 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-93ec2669-4d10-485b-82ac-ee2757a931fe tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:00.511591 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-93ec2669-4d10-485b-82ac-ee2757a931fe tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:00.528095 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-93ec2669-4d10-485b-82ac-ee2757a931fe tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1218 microversion: 2.1 time: 0.399051 Aug 17 08:38:00.528688 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 16/24] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:00 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1218 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:01.134399 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7f76591b-9a53-4918-8962-0aedba11b701 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:01.135016 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7f76591b-9a53-4918-8962-0aedba11b701 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:01.144041 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7f76591b-9a53-4918-8962-0aedba11b701 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:01.146373 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7f76591b-9a53-4918-8962-0aedba11b701 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:01.146985 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7f76591b-9a53-4918-8962-0aedba11b701 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:01.149564 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7f76591b-9a53-4918-8962-0aedba11b701 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:01.149564 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7f76591b-9a53-4918-8962-0aedba11b701 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:01.156231 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7f76591b-9a53-4918-8962-0aedba11b701 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:01.191599 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-d2094419-8e2e-4b3d-9a55-aa19311908d5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Flavor limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 08:38:01.193382 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-d2094419-8e2e-4b3d-9a55-aa19311908d5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Image limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 08:38:01.194368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-d2094419-8e2e-4b3d-9a55-aa19311908d5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Flavor pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 08:38:01.194904 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-d2094419-8e2e-4b3d-9a55-aa19311908d5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Image pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 08:38:01.195951 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-d2094419-8e2e-4b3d-9a55-aa19311908d5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 08:38:01.206839 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d2094419-8e2e-4b3d-9a55-aa19311908d5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:01.209996 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d2094419-8e2e-4b3d-9a55-aa19311908d5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:01.210653 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d2094419-8e2e-4b3d-9a55-aa19311908d5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:01.212227 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d2094419-8e2e-4b3d-9a55-aa19311908d5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:01.213807 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d2094419-8e2e-4b3d-9a55-aa19311908d5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:01.214510 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d2094419-8e2e-4b3d-9a55-aa19311908d5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:01.251453 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-d2094419-8e2e-4b3d-9a55-aa19311908d5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Getting quotas for project 458a894213fa47d78568eefbb75f05b3. Resources: {'cores', 'instances', 'ram'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:38:01.258818 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-d2094419-8e2e-4b3d-9a55-aa19311908d5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Getting quotas for user d0aea5553e1043889571c50c3b01cacc and project 458a894213fa47d78568eefbb75f05b3. Resources: {'cores', 'instances', 'ram'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:38:01.282183 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d2094419-8e2e-4b3d-9a55-aa19311908d5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Going to run 1 instances... {{(pid=127298) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 08:38:01.285215 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d2094419-8e2e-4b3d-9a55-aa19311908d5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4467450c-a35c-42e3-af85-a13291b0b2aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 08:38:01.346139 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d2094419-8e2e-4b3d-9a55-aa19311908d5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.245059 Aug 17 08:38:01.346982 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 9/25] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 08:37:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 2247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 08:38:01.360059 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d50a644a-83c0-456a-a358-c865d66063a2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:01.361193 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d50a644a-83c0-456a-a358-c865d66063a2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:01.466592 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-7f76591b-9a53-4918-8962-0aedba11b701 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:01.476025 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-7f76591b-9a53-4918-8962-0aedba11b701 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1224 microversion: 2.1 time: 0.345602 Aug 17 08:38:01.480307 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 17/26] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:01 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1224 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:38:01.575514 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-595db5b8-556b-4c11-b5f7-0405ff2df7ab tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:01.578523 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-595db5b8-556b-4c11-b5f7-0405ff2df7ab tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:01.625024 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-595db5b8-556b-4c11-b5f7-0405ff2df7ab tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:01.626593 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-595db5b8-556b-4c11-b5f7-0405ff2df7ab tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:01.627079 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-595db5b8-556b-4c11-b5f7-0405ff2df7ab tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:01.633411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-595db5b8-556b-4c11-b5f7-0405ff2df7ab tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:01.633921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-595db5b8-556b-4c11-b5f7-0405ff2df7ab tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:01.637000 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-595db5b8-556b-4c11-b5f7-0405ff2df7ab tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:02.276792 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-d50a644a-83c0-456a-a358-c865d66063a2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:02.288300 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d50a644a-83c0-456a-a358-c865d66063a2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1237 microversion: 2.1 time: 0.932177 Aug 17 08:38:02.290685 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 10/27] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:01 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1237 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:02.503558 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-362e7b5f-c9fe-4a3f-b5b8-8399518ababd tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:02.504290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-362e7b5f-c9fe-4a3f-b5b8-8399518ababd tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:02.521082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-362e7b5f-c9fe-4a3f-b5b8-8399518ababd tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:02.522814 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-362e7b5f-c9fe-4a3f-b5b8-8399518ababd tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:02.523277 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-362e7b5f-c9fe-4a3f-b5b8-8399518ababd tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:02.528047 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-362e7b5f-c9fe-4a3f-b5b8-8399518ababd tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:02.528631 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-362e7b5f-c9fe-4a3f-b5b8-8399518ababd tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:02.530710 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-362e7b5f-c9fe-4a3f-b5b8-8399518ababd tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:02.644643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-595db5b8-556b-4c11-b5f7-0405ff2df7ab tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:02.653462 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-595db5b8-556b-4c11-b5f7-0405ff2df7ab tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1218 microversion: 2.1 time: 1.108034 Aug 17 08:38:02.654051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 18/28] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:01 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1218 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:02.974271 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-362e7b5f-c9fe-4a3f-b5b8-8399518ababd tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:03.003513 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-362e7b5f-c9fe-4a3f-b5b8-8399518ababd tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1272 microversion: 2.1 time: 0.507230 Aug 17 08:38:03.009508 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 11/29] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:02 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1272 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:38:03.316336 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e64c861c-ed99-479c-851a-3ff7bae33412 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:03.317598 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e64c861c-ed99-479c-851a-3ff7bae33412 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:03.338010 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e64c861c-ed99-479c-851a-3ff7bae33412 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:03.348223 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e64c861c-ed99-479c-851a-3ff7bae33412 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:03.348883 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e64c861c-ed99-479c-851a-3ff7bae33412 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:03.349657 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e64c861c-ed99-479c-851a-3ff7bae33412 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:03.350137 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e64c861c-ed99-479c-851a-3ff7bae33412 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:03.350566 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e64c861c-ed99-479c-851a-3ff7bae33412 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:03.674726 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-7b6bfe30-824f-4d5a-9ab0-e0a097ec52ca tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:03.675340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7b6bfe30-824f-4d5a-9ab0-e0a097ec52ca tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:03.685265 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7b6bfe30-824f-4d5a-9ab0-e0a097ec52ca tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:03.687325 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7b6bfe30-824f-4d5a-9ab0-e0a097ec52ca tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:03.688481 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7b6bfe30-824f-4d5a-9ab0-e0a097ec52ca tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:03.690966 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7b6bfe30-824f-4d5a-9ab0-e0a097ec52ca tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:03.692752 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7b6bfe30-824f-4d5a-9ab0-e0a097ec52ca tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:03.695438 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7b6bfe30-824f-4d5a-9ab0-e0a097ec52ca tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:03.827574 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e64c861c-ed99-479c-851a-3ff7bae33412 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:03.851132 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e64c861c-ed99-479c-851a-3ff7bae33412 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1241 microversion: 2.1 time: 0.531867 Aug 17 08:38:03.852127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 19/30] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:03 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1241 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:03.934491 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-7b6bfe30-824f-4d5a-9ab0-e0a097ec52ca tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:03.944630 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-7b6bfe30-824f-4d5a-9ab0-e0a097ec52ca tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1284 microversion: 2.1 time: 0.273522 Aug 17 08:38:03.951830 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 12/31] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:03 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1284 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:38:04.029029 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-93816a84-8c35-4a58-8387-420308923be9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:04.029863 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-93816a84-8c35-4a58-8387-420308923be9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:04.058511 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-93816a84-8c35-4a58-8387-420308923be9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:04.063524 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-93816a84-8c35-4a58-8387-420308923be9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:04.066242 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-93816a84-8c35-4a58-8387-420308923be9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:04.070405 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-93816a84-8c35-4a58-8387-420308923be9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:04.070908 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-93816a84-8c35-4a58-8387-420308923be9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:04.078113 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-93816a84-8c35-4a58-8387-420308923be9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:04.525833 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-93816a84-8c35-4a58-8387-420308923be9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:04.533507 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-93816a84-8c35-4a58-8387-420308923be9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1290 microversion: 2.1 time: 0.508790 Aug 17 08:38:04.542271 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 20/32] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:04 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1290 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:04.872954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-7df4b59f-38e0-4ac7-8774-7e2c6587f27f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:04.873562 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7df4b59f-38e0-4ac7-8774-7e2c6587f27f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:04.883970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7df4b59f-38e0-4ac7-8774-7e2c6587f27f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:04.886533 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7df4b59f-38e0-4ac7-8774-7e2c6587f27f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:04.888143 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7df4b59f-38e0-4ac7-8774-7e2c6587f27f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:04.889888 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7df4b59f-38e0-4ac7-8774-7e2c6587f27f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:04.891921 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7df4b59f-38e0-4ac7-8774-7e2c6587f27f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:04.893368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7df4b59f-38e0-4ac7-8774-7e2c6587f27f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:04.972395 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b34123c4-7f77-4638-9961-ef450f268617 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:04.973238 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b34123c4-7f77-4638-9961-ef450f268617 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:04.986317 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b34123c4-7f77-4638-9961-ef450f268617 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:04.986909 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b34123c4-7f77-4638-9961-ef450f268617 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:04.987254 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b34123c4-7f77-4638-9961-ef450f268617 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:04.987997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b34123c4-7f77-4638-9961-ef450f268617 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:04.989005 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b34123c4-7f77-4638-9961-ef450f268617 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:04.994405 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b34123c4-7f77-4638-9961-ef450f268617 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:05.256188 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b34123c4-7f77-4638-9961-ef450f268617 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:05.275839 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b34123c4-7f77-4638-9961-ef450f268617 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1272 microversion: 2.1 time: 0.307309 Aug 17 08:38:05.277312 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 21/33] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:04 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1272 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:05.560583 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f411b9d3-5623-4814-9962-87b044f84636 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:05.561209 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f411b9d3-5623-4814-9962-87b044f84636 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:05.572873 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-7df4b59f-38e0-4ac7-8774-7e2c6587f27f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:05.574955 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f411b9d3-5623-4814-9962-87b044f84636 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:05.577724 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f411b9d3-5623-4814-9962-87b044f84636 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:05.578211 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f411b9d3-5623-4814-9962-87b044f84636 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:05.579223 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f411b9d3-5623-4814-9962-87b044f84636 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:05.581444 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f411b9d3-5623-4814-9962-87b044f84636 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:05.582109 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f411b9d3-5623-4814-9962-87b044f84636 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:05.589004 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-7df4b59f-38e0-4ac7-8774-7e2c6587f27f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1289 microversion: 2.1 time: 0.719795 Aug 17 08:38:05.604524 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 13/34] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:04 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1289 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:06.034465 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-f411b9d3-5623-4814-9962-87b044f84636 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:06.044031 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f411b9d3-5623-4814-9962-87b044f84636 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1320 microversion: 2.1 time: 0.489575 Aug 17 08:38:06.045948 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 22/35] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:05 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1320 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:06.298559 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-dbf10f15-99a3-4050-8bcf-ac1ab2b4a2ba tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:06.299271 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-dbf10f15-99a3-4050-8bcf-ac1ab2b4a2ba tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:06.308881 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dbf10f15-99a3-4050-8bcf-ac1ab2b4a2ba tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:06.309569 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dbf10f15-99a3-4050-8bcf-ac1ab2b4a2ba tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:06.310314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dbf10f15-99a3-4050-8bcf-ac1ab2b4a2ba tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:06.311829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dbf10f15-99a3-4050-8bcf-ac1ab2b4a2ba tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:06.312178 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dbf10f15-99a3-4050-8bcf-ac1ab2b4a2ba tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:06.312680 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dbf10f15-99a3-4050-8bcf-ac1ab2b4a2ba tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:06.563031 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-dbf10f15-99a3-4050-8bcf-ac1ab2b4a2ba tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:06.572023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-dbf10f15-99a3-4050-8bcf-ac1ab2b4a2ba tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1314 microversion: 2.1 time: 0.277463 Aug 17 08:38:06.586405 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 14/36] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:06 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:38:06.610214 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-123f90bd-668c-4045-ac68-cf6d75828385 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:06.611223 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-123f90bd-668c-4045-ac68-cf6d75828385 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:06.618586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-123f90bd-668c-4045-ac68-cf6d75828385 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:06.619300 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-123f90bd-668c-4045-ac68-cf6d75828385 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:06.619909 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-123f90bd-668c-4045-ac68-cf6d75828385 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:06.620588 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-123f90bd-668c-4045-ac68-cf6d75828385 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:06.621190 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-123f90bd-668c-4045-ac68-cf6d75828385 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:06.621605 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-123f90bd-668c-4045-ac68-cf6d75828385 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:06.700953 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-123f90bd-668c-4045-ac68-cf6d75828385 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:06.712499 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-123f90bd-668c-4045-ac68-cf6d75828385 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1289 microversion: 2.1 time: 0.106069 Aug 17 08:38:06.715909 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 23/37] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:06 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1289 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:07.070173 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-39ec322c-ccdf-4358-8832-1e5e05798a81 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:07.071458 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-39ec322c-ccdf-4358-8832-1e5e05798a81 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:07.087628 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39ec322c-ccdf-4358-8832-1e5e05798a81 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:07.088529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39ec322c-ccdf-4358-8832-1e5e05798a81 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:07.090052 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39ec322c-ccdf-4358-8832-1e5e05798a81 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:07.092520 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39ec322c-ccdf-4358-8832-1e5e05798a81 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:07.094364 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39ec322c-ccdf-4358-8832-1e5e05798a81 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:07.097328 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39ec322c-ccdf-4358-8832-1e5e05798a81 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:07.497146 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-39ec322c-ccdf-4358-8832-1e5e05798a81 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:07.507144 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-39ec322c-ccdf-4358-8832-1e5e05798a81 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1320 microversion: 2.1 time: 0.441312 Aug 17 08:38:07.525977 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 15/38] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:07 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1320 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:38:07.594198 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-622f90c6-93e1-4256-8617-a41c4b004f8a tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:07.594890 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-622f90c6-93e1-4256-8617-a41c4b004f8a tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:07.613016 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-622f90c6-93e1-4256-8617-a41c4b004f8a tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:07.614039 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-622f90c6-93e1-4256-8617-a41c4b004f8a tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:07.615988 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-622f90c6-93e1-4256-8617-a41c4b004f8a tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:07.618242 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-622f90c6-93e1-4256-8617-a41c4b004f8a tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:07.618825 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-622f90c6-93e1-4256-8617-a41c4b004f8a tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:07.619416 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-622f90c6-93e1-4256-8617-a41c4b004f8a tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:07.735713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a9cdfa6b-c725-48ea-8daf-61c90765b2ac tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:07.736590 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a9cdfa6b-c725-48ea-8daf-61c90765b2ac tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:07.749394 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a9cdfa6b-c725-48ea-8daf-61c90765b2ac tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:07.751109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a9cdfa6b-c725-48ea-8daf-61c90765b2ac tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:07.753780 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a9cdfa6b-c725-48ea-8daf-61c90765b2ac tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:07.756454 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a9cdfa6b-c725-48ea-8daf-61c90765b2ac tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:07.757299 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a9cdfa6b-c725-48ea-8daf-61c90765b2ac tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:07.759965 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a9cdfa6b-c725-48ea-8daf-61c90765b2ac tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:07.888941 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a9cdfa6b-c725-48ea-8daf-61c90765b2ac tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:07.898923 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a9cdfa6b-c725-48ea-8daf-61c90765b2ac tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1307 microversion: 2.1 time: 0.167988 Aug 17 08:38:07.901658 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 16/39] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:07 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1307 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:07.998125 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-622f90c6-93e1-4256-8617-a41c4b004f8a tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:08.008718 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-622f90c6-93e1-4256-8617-a41c4b004f8a tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1314 microversion: 2.1 time: 0.419183 Aug 17 08:38:08.009670 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 24/40] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:07 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:08.534108 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b350d642-8bcb-4ef9-94d3-262cf240ce8a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:08.534721 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b350d642-8bcb-4ef9-94d3-262cf240ce8a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:08.543461 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b350d642-8bcb-4ef9-94d3-262cf240ce8a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:08.543992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b350d642-8bcb-4ef9-94d3-262cf240ce8a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:08.544437 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b350d642-8bcb-4ef9-94d3-262cf240ce8a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:08.545142 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b350d642-8bcb-4ef9-94d3-262cf240ce8a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:08.545597 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b350d642-8bcb-4ef9-94d3-262cf240ce8a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:08.546019 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b350d642-8bcb-4ef9-94d3-262cf240ce8a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:08.921128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-00554c79-25d0-4ce9-a1d2-6bcf279894e1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:08.922305 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-00554c79-25d0-4ce9-a1d2-6bcf279894e1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:08.935351 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-00554c79-25d0-4ce9-a1d2-6bcf279894e1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:08.936238 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-00554c79-25d0-4ce9-a1d2-6bcf279894e1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:08.940231 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-00554c79-25d0-4ce9-a1d2-6bcf279894e1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:08.942071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-00554c79-25d0-4ce9-a1d2-6bcf279894e1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:08.942758 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-00554c79-25d0-4ce9-a1d2-6bcf279894e1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:08.943709 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-00554c79-25d0-4ce9-a1d2-6bcf279894e1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:09.587256 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b350d642-8bcb-4ef9-94d3-262cf240ce8a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:09.619207 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b350d642-8bcb-4ef9-94d3-262cf240ce8a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1320 microversion: 2.1 time: 1.085387 Aug 17 08:38:09.633709 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 17/41] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:08 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1320 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:09.639253 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a5c744da-ffaa-4a15-858d-b164505f120c tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:09.639902 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a5c744da-ffaa-4a15-858d-b164505f120c tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:09.667482 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a5c744da-ffaa-4a15-858d-b164505f120c tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:09.673061 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a5c744da-ffaa-4a15-858d-b164505f120c tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:09.675004 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a5c744da-ffaa-4a15-858d-b164505f120c tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:09.676986 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a5c744da-ffaa-4a15-858d-b164505f120c tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:09.677466 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a5c744da-ffaa-4a15-858d-b164505f120c tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:09.677900 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a5c744da-ffaa-4a15-858d-b164505f120c tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:09.695526 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=4 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:09.722441 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-00554c79-25d0-4ce9-a1d2-6bcf279894e1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:09.737243 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-00554c79-25d0-4ce9-a1d2-6bcf279894e1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1362 microversion: 2.1 time: 0.820157 Aug 17 08:38:09.739880 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 25/42] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:08 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1362 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:10.206326 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a5c744da-ffaa-4a15-858d-b164505f120c tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:10.214973 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a5c744da-ffaa-4a15-858d-b164505f120c tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1314 microversion: 2.1 time: 0.591802 Aug 17 08:38:10.215583 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 18/43] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:09 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1314 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:10.641654 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ac99f372-56c0-4040-b5c1-762bd308b2d4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:10.642872 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ac99f372-56c0-4040-b5c1-762bd308b2d4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:10.644915 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=16 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:10.653807 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ac99f372-56c0-4040-b5c1-762bd308b2d4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:10.654292 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ac99f372-56c0-4040-b5c1-762bd308b2d4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:10.657491 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ac99f372-56c0-4040-b5c1-762bd308b2d4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:10.658402 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ac99f372-56c0-4040-b5c1-762bd308b2d4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:10.659036 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ac99f372-56c0-4040-b5c1-762bd308b2d4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:10.661290 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ac99f372-56c0-4040-b5c1-762bd308b2d4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:10.762371 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a3a5d861-00f5-4562-8f93-e1f00b3f771d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:10.763812 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a3a5d861-00f5-4562-8f93-e1f00b3f771d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:10.771678 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a3a5d861-00f5-4562-8f93-e1f00b3f771d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:10.772452 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a3a5d861-00f5-4562-8f93-e1f00b3f771d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:10.773128 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a3a5d861-00f5-4562-8f93-e1f00b3f771d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:10.774014 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a3a5d861-00f5-4562-8f93-e1f00b3f771d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:10.774748 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a3a5d861-00f5-4562-8f93-e1f00b3f771d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:10.776041 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a3a5d861-00f5-4562-8f93-e1f00b3f771d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:10.911402 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ac99f372-56c0-4040-b5c1-762bd308b2d4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:10.918978 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ac99f372-56c0-4040-b5c1-762bd308b2d4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1320 microversion: 2.1 time: 0.281086 Aug 17 08:38:10.924758 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 26/44] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:10 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1320 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:11.230908 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=4 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:11.238704 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a3a5d861-00f5-4562-8f93-e1f00b3f771d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:11.241227 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-77ad400c-790e-4737-a314-f69268ae0cef tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:11.241832 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-77ad400c-790e-4737-a314-f69268ae0cef tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:11.268089 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a3a5d861-00f5-4562-8f93-e1f00b3f771d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1362 microversion: 2.1 time: 0.510855 Aug 17 08:38:11.276861 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-77ad400c-790e-4737-a314-f69268ae0cef tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:11.278610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-77ad400c-790e-4737-a314-f69268ae0cef tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:11.282305 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-77ad400c-790e-4737-a314-f69268ae0cef tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:11.283209 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-77ad400c-790e-4737-a314-f69268ae0cef tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:11.283814 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 19/45] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:10 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1362 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:11.284443 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-77ad400c-790e-4737-a314-f69268ae0cef tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:11.285047 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-77ad400c-790e-4737-a314-f69268ae0cef tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:11.728367 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-77ad400c-790e-4737-a314-f69268ae0cef tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:11.741368 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-77ad400c-790e-4737-a314-f69268ae0cef tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1314 microversion: 2.1 time: 0.507191 Aug 17 08:38:11.744080 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 27/46] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:11 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:11.934792 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-ced9cedb-7cf3-44da-8b0f-58be9a9868d6 req-2279642f-ed2b-467d-82aa-177413e2385e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acc7affb-d8db-4d51-a10a-95235ce04aa3", "tag": "9df79908-9527-4436-9dcf-41c6d5696780"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:38:11.942223 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-efd08929-a8ed-47ec-898b-5bf3a8d88856 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:11.946110 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-efd08929-a8ed-47ec-898b-5bf3a8d88856 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:11.962763 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-ced9cedb-7cf3-44da-8b0f-58be9a9868d6 req-2279642f-ed2b-467d-82aa-177413e2385e service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:11.963245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-ced9cedb-7cf3-44da-8b0f-58be9a9868d6 req-2279642f-ed2b-467d-82aa-177413e2385e service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:11.965118 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-efd08929-a8ed-47ec-898b-5bf3a8d88856 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:11.965602 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-efd08929-a8ed-47ec-898b-5bf3a8d88856 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:11.966111 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-efd08929-a8ed-47ec-898b-5bf3a8d88856 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:11.967632 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-ced9cedb-7cf3-44da-8b0f-58be9a9868d6 req-2279642f-ed2b-467d-82aa-177413e2385e service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:11.971227 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-efd08929-a8ed-47ec-898b-5bf3a8d88856 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:11.971739 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-efd08929-a8ed-47ec-898b-5bf3a8d88856 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:11.972156 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-efd08929-a8ed-47ec-898b-5bf3a8d88856 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:12.041792 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-ced9cedb-7cf3-44da-8b0f-58be9a9868d6 req-2279642f-ed2b-467d-82aa-177413e2385e service nova] Creating event network-changed:9df79908-9527-4436-9dcf-41c6d5696780 for instance acc7affb-d8db-4d51-a10a-95235ce04aa3 on hv-cinder-85331 Aug 17 08:38:12.042614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-ced9cedb-7cf3-44da-8b0f-58be9a9868d6 req-2279642f-ed2b-467d-82aa-177413e2385e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127298) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 17 08:38:12.043259 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-ced9cedb-7cf3-44da-8b0f-58be9a9868d6 req-2279642f-ed2b-467d-82aa-177413e2385e service nova] Acquired lock "compute-rpcapi-router" {{(pid=127298) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 17 08:38:12.044688 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9022c421-dde5-4cce-8cd5-3493a613d2c3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:12.045308 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9022c421-dde5-4cce-8cd5-3493a613d2c3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:12.045961 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9022c421-dde5-4cce-8cd5-3493a613d2c3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:12.046830 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9022c421-dde5-4cce-8cd5-3493a613d2c3 None None] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:12.047470 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9022c421-dde5-4cce-8cd5-3493a613d2c3 None None] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:12.047940 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9022c421-dde5-4cce-8cd5-3493a613d2c3 None None] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:12.058461 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.compute.rpcapi [None req-9022c421-dde5-4cce-8cd5-3493a613d2c3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 17 08:38:12.060080 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9022c421-dde5-4cce-8cd5-3493a613d2c3 None None] Releasing lock "compute-rpcapi-router" {{(pid=127298) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 17 08:38:12.087502 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9022c421-dde5-4cce-8cd5-3493a613d2c3 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.474341 Aug 17 08:38:12.088731 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 20/47] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:38:12.163665 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-efd08929-a8ed-47ec-898b-5bf3a8d88856 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:12.172995 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-efd08929-a8ed-47ec-898b-5bf3a8d88856 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1320 microversion: 2.1 time: 0.235217 Aug 17 08:38:12.173586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 28/48] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:11 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1320 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:38:12.296180 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c36713ad-7848-4ee4-ad13-4bd94e07419d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:12.298041 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c36713ad-7848-4ee4-ad13-4bd94e07419d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:12.302479 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=22 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:12.306486 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c36713ad-7848-4ee4-ad13-4bd94e07419d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:12.307264 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c36713ad-7848-4ee4-ad13-4bd94e07419d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:12.307875 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c36713ad-7848-4ee4-ad13-4bd94e07419d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:12.308755 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c36713ad-7848-4ee4-ad13-4bd94e07419d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:12.309361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c36713ad-7848-4ee4-ad13-4bd94e07419d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:12.310392 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c36713ad-7848-4ee4-ad13-4bd94e07419d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:12.603026 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c36713ad-7848-4ee4-ad13-4bd94e07419d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:12.612322 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c36713ad-7848-4ee4-ad13-4bd94e07419d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1362 microversion: 2.1 time: 0.321547 Aug 17 08:38:12.613431 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 21/49] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:12 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1362 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:12.767415 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3fab3516-eb05-49fe-af61-a07cf2ca3c11 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:12.768099 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3fab3516-eb05-49fe-af61-a07cf2ca3c11 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:12.777581 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3fab3516-eb05-49fe-af61-a07cf2ca3c11 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:12.778489 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3fab3516-eb05-49fe-af61-a07cf2ca3c11 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:12.780929 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3fab3516-eb05-49fe-af61-a07cf2ca3c11 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:12.783289 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3fab3516-eb05-49fe-af61-a07cf2ca3c11 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:12.784111 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3fab3516-eb05-49fe-af61-a07cf2ca3c11 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:12.785927 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3fab3516-eb05-49fe-af61-a07cf2ca3c11 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:13.050170 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3fab3516-eb05-49fe-af61-a07cf2ca3c11 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:13.057977 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3fab3516-eb05-49fe-af61-a07cf2ca3c11 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1314 microversion: 2.1 time: 0.294563 Aug 17 08:38:13.061809 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 29/50] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:12 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:13.201975 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1ea76f74-76d7-491c-8aca-ca79e2262a07 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:13.202559 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1ea76f74-76d7-491c-8aca-ca79e2262a07 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:13.217002 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1ea76f74-76d7-491c-8aca-ca79e2262a07 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:13.217501 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1ea76f74-76d7-491c-8aca-ca79e2262a07 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:13.221106 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1ea76f74-76d7-491c-8aca-ca79e2262a07 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:13.224169 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1ea76f74-76d7-491c-8aca-ca79e2262a07 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:13.224653 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1ea76f74-76d7-491c-8aca-ca79e2262a07 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:13.225086 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1ea76f74-76d7-491c-8aca-ca79e2262a07 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:13.555662 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1ea76f74-76d7-491c-8aca-ca79e2262a07 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:13.609767 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1ea76f74-76d7-491c-8aca-ca79e2262a07 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1320 microversion: 2.1 time: 0.403174 Aug 17 08:38:13.614069 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 22/51] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:13 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1320 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:13.640048 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c33928e1-9e55-4cde-8394-f50321bf082d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:13.640847 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c33928e1-9e55-4cde-8394-f50321bf082d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:13.647670 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c33928e1-9e55-4cde-8394-f50321bf082d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:13.648367 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c33928e1-9e55-4cde-8394-f50321bf082d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:13.649117 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c33928e1-9e55-4cde-8394-f50321bf082d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:13.650172 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c33928e1-9e55-4cde-8394-f50321bf082d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:13.650918 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c33928e1-9e55-4cde-8394-f50321bf082d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:13.651491 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c33928e1-9e55-4cde-8394-f50321bf082d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:13.953527 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c33928e1-9e55-4cde-8394-f50321bf082d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:13.964112 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c33928e1-9e55-4cde-8394-f50321bf082d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1362 microversion: 2.1 time: 0.331868 Aug 17 08:38:13.968945 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 30/52] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:13 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:14.095939 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8830e89e-22fc-46c8-b9e5-95330b931f70 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:14.096602 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8830e89e-22fc-46c8-b9e5-95330b931f70 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:14.105272 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-84c3729e-a5b9-4bc1-8965-03de9016cf92 req-d3e81add-ae35-40bf-88b9-2c84f38fa853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcce3821-0099-45bc-9283-1ad5632080ce", "tag": "8843e2b2-9e74-4082-acb6-0b36b20085b1"}, {"name": "network-changed", "server_uuid": "eefed036-89ed-46ed-8d8d-ab6b8a9abfce", "tag": "88ccd260-6726-4fd3-b8cd-7a065527f5cb"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:38:14.124534 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8830e89e-22fc-46c8-b9e5-95330b931f70 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:14.127108 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8830e89e-22fc-46c8-b9e5-95330b931f70 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:14.127980 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8830e89e-22fc-46c8-b9e5-95330b931f70 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:14.129431 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8830e89e-22fc-46c8-b9e5-95330b931f70 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:14.131514 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8830e89e-22fc-46c8-b9e5-95330b931f70 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:14.132482 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8830e89e-22fc-46c8-b9e5-95330b931f70 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:14.150782 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-84c3729e-a5b9-4bc1-8965-03de9016cf92 req-d3e81add-ae35-40bf-88b9-2c84f38fa853 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:14.151294 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-84c3729e-a5b9-4bc1-8965-03de9016cf92 req-d3e81add-ae35-40bf-88b9-2c84f38fa853 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:14.153215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-84c3729e-a5b9-4bc1-8965-03de9016cf92 req-d3e81add-ae35-40bf-88b9-2c84f38fa853 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:14.231672 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-84c3729e-a5b9-4bc1-8965-03de9016cf92 req-d3e81add-ae35-40bf-88b9-2c84f38fa853 service nova] Creating event network-changed:8843e2b2-9e74-4082-acb6-0b36b20085b1 for instance fcce3821-0099-45bc-9283-1ad5632080ce on hv-cinder-85331 Aug 17 08:38:14.233851 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-84c3729e-a5b9-4bc1-8965-03de9016cf92 req-d3e81add-ae35-40bf-88b9-2c84f38fa853 service nova] Creating event network-changed:88ccd260-6726-4fd3-b8cd-7a065527f5cb for instance eefed036-89ed-46ed-8d8d-ab6b8a9abfce on hv-cinder-85331 Aug 17 08:38:14.234553 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-84c3729e-a5b9-4bc1-8965-03de9016cf92 req-d3e81add-ae35-40bf-88b9-2c84f38fa853 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127297) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 17 08:38:14.235103 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-84c3729e-a5b9-4bc1-8965-03de9016cf92 req-d3e81add-ae35-40bf-88b9-2c84f38fa853 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127297) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 17 08:38:14.236412 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-66b30daf-951f-472b-80af-bec84c82b954 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:14.237038 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-66b30daf-951f-472b-80af-bec84c82b954 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:14.237612 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-66b30daf-951f-472b-80af-bec84c82b954 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:14.238509 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-66b30daf-951f-472b-80af-bec84c82b954 None None] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:14.240674 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-66b30daf-951f-472b-80af-bec84c82b954 None None] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:14.241302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-66b30daf-951f-472b-80af-bec84c82b954 None None] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:14.259243 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.compute.rpcapi [None req-66b30daf-951f-472b-80af-bec84c82b954 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 17 08:38:14.261331 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-66b30daf-951f-472b-80af-bec84c82b954 None None] Releasing lock "compute-rpcapi-router" {{(pid=127297) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 17 08:38:14.313006 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-66b30daf-951f-472b-80af-bec84c82b954 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.211199 Aug 17 08:38:14.313789 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 31/53] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:38:14.483363 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8830e89e-22fc-46c8-b9e5-95330b931f70 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:14.497965 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8830e89e-22fc-46c8-b9e5-95330b931f70 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1314 microversion: 2.1 time: 0.413125 Aug 17 08:38:14.503046 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 23/54] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:14 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:14.634294 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-aac9af1f-80c2-4922-99ca-48b3bd5ae29d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:14.634994 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-aac9af1f-80c2-4922-99ca-48b3bd5ae29d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:14.651075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aac9af1f-80c2-4922-99ca-48b3bd5ae29d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:14.651809 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aac9af1f-80c2-4922-99ca-48b3bd5ae29d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:14.652401 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aac9af1f-80c2-4922-99ca-48b3bd5ae29d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:14.653156 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aac9af1f-80c2-4922-99ca-48b3bd5ae29d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:14.653558 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aac9af1f-80c2-4922-99ca-48b3bd5ae29d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:14.653979 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aac9af1f-80c2-4922-99ca-48b3bd5ae29d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:14.658139 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=100 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:14.989940 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c4a072ec-b7f5-45e4-8efa-3f61a9d19281 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:14.991195 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c4a072ec-b7f5-45e4-8efa-3f61a9d19281 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:15.000482 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c4a072ec-b7f5-45e4-8efa-3f61a9d19281 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:15.001325 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c4a072ec-b7f5-45e4-8efa-3f61a9d19281 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:15.002034 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c4a072ec-b7f5-45e4-8efa-3f61a9d19281 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:15.002995 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c4a072ec-b7f5-45e4-8efa-3f61a9d19281 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:15.003876 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c4a072ec-b7f5-45e4-8efa-3f61a9d19281 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:15.005208 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c4a072ec-b7f5-45e4-8efa-3f61a9d19281 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:15.020209 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-aac9af1f-80c2-4922-99ca-48b3bd5ae29d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:15.030378 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-aac9af1f-80c2-4922-99ca-48b3bd5ae29d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1320 microversion: 2.1 time: 0.400344 Aug 17 08:38:15.035625 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 32/55] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:14 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1320 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:15.236752 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c4a072ec-b7f5-45e4-8efa-3f61a9d19281 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:15.267982 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c4a072ec-b7f5-45e4-8efa-3f61a9d19281 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1362 microversion: 2.1 time: 0.283473 Aug 17 08:38:15.269286 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 24/56] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:14 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1362 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:15.528579 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4f8dc9c8-572a-4bb6-b247-2f7010e444ac tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:15.529866 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-4f8dc9c8-572a-4bb6-b247-2f7010e444ac tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:15.544426 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f8dc9c8-572a-4bb6-b247-2f7010e444ac tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:15.545042 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f8dc9c8-572a-4bb6-b247-2f7010e444ac tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:15.546365 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f8dc9c8-572a-4bb6-b247-2f7010e444ac tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:15.547787 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f8dc9c8-572a-4bb6-b247-2f7010e444ac tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:15.550430 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f8dc9c8-572a-4bb6-b247-2f7010e444ac tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:15.552848 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f8dc9c8-572a-4bb6-b247-2f7010e444ac tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:15.873987 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-4f8dc9c8-572a-4bb6-b247-2f7010e444ac tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:15.882605 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4f8dc9c8-572a-4bb6-b247-2f7010e444ac tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1314 microversion: 2.1 time: 0.358548 Aug 17 08:38:15.884341 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 33/57] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:15 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:16.063163 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3e5bff69-8879-4bb7-9284-97ca3b526d2a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:16.065208 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3e5bff69-8879-4bb7-9284-97ca3b526d2a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:16.088478 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e5bff69-8879-4bb7-9284-97ca3b526d2a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:16.090662 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e5bff69-8879-4bb7-9284-97ca3b526d2a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:16.091361 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e5bff69-8879-4bb7-9284-97ca3b526d2a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:16.092262 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e5bff69-8879-4bb7-9284-97ca3b526d2a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:16.098603 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e5bff69-8879-4bb7-9284-97ca3b526d2a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:16.099135 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e5bff69-8879-4bb7-9284-97ca3b526d2a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:16.334804 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3e5bff69-8879-4bb7-9284-97ca3b526d2a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:16.344992 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3e5bff69-8879-4bb7-9284-97ca3b526d2a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1320 microversion: 2.1 time: 0.288228 Aug 17 08:38:16.345832 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 34/58] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:16 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1320 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:16.366750 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-dfd8f524-7f84-48ac-9612-51dcbc5b5ba2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:16.367593 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-dfd8f524-7f84-48ac-9612-51dcbc5b5ba2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:16.373557 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dfd8f524-7f84-48ac-9612-51dcbc5b5ba2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:16.374262 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dfd8f524-7f84-48ac-9612-51dcbc5b5ba2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:16.374854 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dfd8f524-7f84-48ac-9612-51dcbc5b5ba2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:16.375561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dfd8f524-7f84-48ac-9612-51dcbc5b5ba2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:16.376009 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dfd8f524-7f84-48ac-9612-51dcbc5b5ba2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:16.376419 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dfd8f524-7f84-48ac-9612-51dcbc5b5ba2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:16.402724 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-5d060163-b601-440c-b876-4d6ddced3ba1 req-b57fb6cf-3754-41f6-b4f4-f2e6d6c5d000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c224c091-7aa6-49a0-b269-a833010f6cc9", "tag": "6b201d95-6d5e-4e67-84ac-5b8cfa9080cd"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:38:16.422334 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-5d060163-b601-440c-b876-4d6ddced3ba1 req-b57fb6cf-3754-41f6-b4f4-f2e6d6c5d000 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:16.436966 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-5d060163-b601-440c-b876-4d6ddced3ba1 req-b57fb6cf-3754-41f6-b4f4-f2e6d6c5d000 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:16.438041 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-5d060163-b601-440c-b876-4d6ddced3ba1 req-b57fb6cf-3754-41f6-b4f4-f2e6d6c5d000 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:16.463275 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-5d060163-b601-440c-b876-4d6ddced3ba1 req-b57fb6cf-3754-41f6-b4f4-f2e6d6c5d000 service nova] Creating event network-changed:6b201d95-6d5e-4e67-84ac-5b8cfa9080cd for instance c224c091-7aa6-49a0-b269-a833010f6cc9 on hv-cinder-85331 Aug 17 08:38:16.469426 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-5d060163-b601-440c-b876-4d6ddced3ba1 req-b57fb6cf-3754-41f6-b4f4-f2e6d6c5d000 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.523556 Aug 17 08:38:16.470046 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 25/59] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:38:16.696263 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-dfd8f524-7f84-48ac-9612-51dcbc5b5ba2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:16.709970 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-dfd8f524-7f84-48ac-9612-51dcbc5b5ba2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1362 microversion: 2.1 time: 0.349009 Aug 17 08:38:16.713266 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 35/60] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:16 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1362 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:16.907862 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f2aacdb0-ef7b-4652-a88a-3ad88ea15bab tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:16.908847 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f2aacdb0-ef7b-4652-a88a-3ad88ea15bab tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:16.919141 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f2aacdb0-ef7b-4652-a88a-3ad88ea15bab tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:16.919657 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f2aacdb0-ef7b-4652-a88a-3ad88ea15bab tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:16.921493 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f2aacdb0-ef7b-4652-a88a-3ad88ea15bab tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:16.922515 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f2aacdb0-ef7b-4652-a88a-3ad88ea15bab tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:16.923664 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f2aacdb0-ef7b-4652-a88a-3ad88ea15bab tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:16.924353 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f2aacdb0-ef7b-4652-a88a-3ad88ea15bab tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:17.133883 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f2aacdb0-ef7b-4652-a88a-3ad88ea15bab tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:17.146897 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f2aacdb0-ef7b-4652-a88a-3ad88ea15bab tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1314 microversion: 2.1 time: 0.243718 Aug 17 08:38:17.159054 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 26/61] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:16 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:17.367371 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f9837513-30da-4005-9a5e-f7f71bad691e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:17.368790 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f9837513-30da-4005-9a5e-f7f71bad691e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:17.376172 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f9837513-30da-4005-9a5e-f7f71bad691e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:17.376925 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f9837513-30da-4005-9a5e-f7f71bad691e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:17.377501 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f9837513-30da-4005-9a5e-f7f71bad691e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:17.378348 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f9837513-30da-4005-9a5e-f7f71bad691e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:17.379069 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f9837513-30da-4005-9a5e-f7f71bad691e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:17.379770 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f9837513-30da-4005-9a5e-f7f71bad691e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:17.733946 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6ccff917-eaa6-4ed8-9786-2f922ed7252d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:17.734694 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6ccff917-eaa6-4ed8-9786-2f922ed7252d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:17.747585 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6ccff917-eaa6-4ed8-9786-2f922ed7252d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:17.750799 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6ccff917-eaa6-4ed8-9786-2f922ed7252d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:17.750799 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6ccff917-eaa6-4ed8-9786-2f922ed7252d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:17.752361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6ccff917-eaa6-4ed8-9786-2f922ed7252d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:17.753598 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6ccff917-eaa6-4ed8-9786-2f922ed7252d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:17.754188 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6ccff917-eaa6-4ed8-9786-2f922ed7252d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:17.801845 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-f9837513-30da-4005-9a5e-f7f71bad691e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:17.812277 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f9837513-30da-4005-9a5e-f7f71bad691e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1320 microversion: 2.1 time: 0.449101 Aug 17 08:38:17.812885 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 36/62] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:17 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1320 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:18.017674 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6ccff917-eaa6-4ed8-9786-2f922ed7252d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:18.021868 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=100 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:18.027516 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6ccff917-eaa6-4ed8-9786-2f922ed7252d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1362 microversion: 2.1 time: 0.297910 Aug 17 08:38:18.030604 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 27/63] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:17 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:18.165698 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8f97b57e-be93-41a2-a6a9-5a6238ab391e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:18.166702 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8f97b57e-be93-41a2-a6a9-5a6238ab391e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:18.177114 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8f97b57e-be93-41a2-a6a9-5a6238ab391e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:18.177892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8f97b57e-be93-41a2-a6a9-5a6238ab391e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:18.180769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8f97b57e-be93-41a2-a6a9-5a6238ab391e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:18.181683 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8f97b57e-be93-41a2-a6a9-5a6238ab391e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:18.183487 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8f97b57e-be93-41a2-a6a9-5a6238ab391e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:18.184676 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8f97b57e-be93-41a2-a6a9-5a6238ab391e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:18.401214 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8f97b57e-be93-41a2-a6a9-5a6238ab391e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:18.413705 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8f97b57e-be93-41a2-a6a9-5a6238ab391e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1314 microversion: 2.1 time: 0.251480 Aug 17 08:38:18.414285 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 37/64] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:18 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:18.835360 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-588e52ab-22a8-4d76-8799-cd940baf4a5f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:18.842171 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-588e52ab-22a8-4d76-8799-cd940baf4a5f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:18.849967 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-588e52ab-22a8-4d76-8799-cd940baf4a5f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:18.850769 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-588e52ab-22a8-4d76-8799-cd940baf4a5f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:18.851412 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-588e52ab-22a8-4d76-8799-cd940baf4a5f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:18.852370 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-588e52ab-22a8-4d76-8799-cd940baf4a5f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:18.856392 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-588e52ab-22a8-4d76-8799-cd940baf4a5f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:18.856841 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-588e52ab-22a8-4d76-8799-cd940baf4a5f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:19.053999 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2bd352c2-0674-4d7e-a4b3-c8d91d105899 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:19.056301 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-2bd352c2-0674-4d7e-a4b3-c8d91d105899 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:19.077339 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2bd352c2-0674-4d7e-a4b3-c8d91d105899 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:19.080806 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2bd352c2-0674-4d7e-a4b3-c8d91d105899 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:19.084999 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2bd352c2-0674-4d7e-a4b3-c8d91d105899 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:19.088768 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2bd352c2-0674-4d7e-a4b3-c8d91d105899 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:19.089463 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2bd352c2-0674-4d7e-a4b3-c8d91d105899 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:19.091457 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2bd352c2-0674-4d7e-a4b3-c8d91d105899 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:19.109861 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-588e52ab-22a8-4d76-8799-cd940baf4a5f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:19.118410 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-588e52ab-22a8-4d76-8799-cd940baf4a5f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1320 microversion: 2.1 time: 0.287707 Aug 17 08:38:19.120830 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 28/65] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:18 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1320 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:19.434894 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-fcc0b083-007c-4541-87da-88036c315877 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:19.435423 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-fcc0b083-007c-4541-87da-88036c315877 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:19.448718 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fcc0b083-007c-4541-87da-88036c315877 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:19.452130 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fcc0b083-007c-4541-87da-88036c315877 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:19.453613 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fcc0b083-007c-4541-87da-88036c315877 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:19.455719 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fcc0b083-007c-4541-87da-88036c315877 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:19.458995 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fcc0b083-007c-4541-87da-88036c315877 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:19.459997 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fcc0b083-007c-4541-87da-88036c315877 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:19.490873 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-2bd352c2-0674-4d7e-a4b3-c8d91d105899 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:19.503175 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2bd352c2-0674-4d7e-a4b3-c8d91d105899 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1362 microversion: 2.1 time: 0.458241 Aug 17 08:38:19.511907 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 38/66] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:19 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1362 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:38:19.837207 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-fcc0b083-007c-4541-87da-88036c315877 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:19.846366 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-fcc0b083-007c-4541-87da-88036c315877 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1314 microversion: 2.1 time: 0.415926 Aug 17 08:38:19.852981 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 29/67] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:19 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:38:20.141017 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-28e67a78-fb8b-491a-ba82-916da5ce54bf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:20.141819 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-28e67a78-fb8b-491a-ba82-916da5ce54bf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:20.157390 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-28e67a78-fb8b-491a-ba82-916da5ce54bf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:20.157889 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-28e67a78-fb8b-491a-ba82-916da5ce54bf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:20.158339 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-28e67a78-fb8b-491a-ba82-916da5ce54bf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:20.159017 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-28e67a78-fb8b-491a-ba82-916da5ce54bf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:20.159465 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-28e67a78-fb8b-491a-ba82-916da5ce54bf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:20.159960 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-28e67a78-fb8b-491a-ba82-916da5ce54bf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:20.379880 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-28e67a78-fb8b-491a-ba82-916da5ce54bf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:20.394242 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-28e67a78-fb8b-491a-ba82-916da5ce54bf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1320 microversion: 2.1 time: 0.255170 Aug 17 08:38:20.412566 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 39/68] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:20 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1320 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:20.526738 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e596082c-bad4-4bf8-afab-3e1833f5bc4d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:20.527910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e596082c-bad4-4bf8-afab-3e1833f5bc4d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:20.536093 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e596082c-bad4-4bf8-afab-3e1833f5bc4d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:20.537516 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e596082c-bad4-4bf8-afab-3e1833f5bc4d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:20.538259 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e596082c-bad4-4bf8-afab-3e1833f5bc4d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:20.539171 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e596082c-bad4-4bf8-afab-3e1833f5bc4d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:20.539867 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e596082c-bad4-4bf8-afab-3e1833f5bc4d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:20.540728 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e596082c-bad4-4bf8-afab-3e1833f5bc4d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:20.789686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e596082c-bad4-4bf8-afab-3e1833f5bc4d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:20.799180 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e596082c-bad4-4bf8-afab-3e1833f5bc4d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1362 microversion: 2.1 time: 0.277374 Aug 17 08:38:20.799998 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 30/69] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:20 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:20.878106 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a7451959-5680-45e1-879f-50af383ba175 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:20.878926 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a7451959-5680-45e1-879f-50af383ba175 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:20.893744 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a7451959-5680-45e1-879f-50af383ba175 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:20.895881 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a7451959-5680-45e1-879f-50af383ba175 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:20.897557 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a7451959-5680-45e1-879f-50af383ba175 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:20.898391 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a7451959-5680-45e1-879f-50af383ba175 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:20.898845 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a7451959-5680-45e1-879f-50af383ba175 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:20.899262 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a7451959-5680-45e1-879f-50af383ba175 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:21.109774 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a7451959-5680-45e1-879f-50af383ba175 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:21.118895 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a7451959-5680-45e1-879f-50af383ba175 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1314 microversion: 2.1 time: 0.248797 Aug 17 08:38:21.120587 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 40/70] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:20 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:21.419972 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2f17f738-4c61-4892-9f87-51b54372f5b8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:21.421320 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2f17f738-4c61-4892-9f87-51b54372f5b8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:21.428209 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:21.430350 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2f17f738-4c61-4892-9f87-51b54372f5b8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:21.431036 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2f17f738-4c61-4892-9f87-51b54372f5b8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:21.431702 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2f17f738-4c61-4892-9f87-51b54372f5b8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:21.432623 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2f17f738-4c61-4892-9f87-51b54372f5b8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:21.433222 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2f17f738-4c61-4892-9f87-51b54372f5b8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:21.433824 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2f17f738-4c61-4892-9f87-51b54372f5b8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:21.823669 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-91fcde4b-a7db-4960-a293-e153ef8dc7d9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:21.824746 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-91fcde4b-a7db-4960-a293-e153ef8dc7d9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:21.836637 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-91fcde4b-a7db-4960-a293-e153ef8dc7d9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:21.840059 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-91fcde4b-a7db-4960-a293-e153ef8dc7d9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:21.841666 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-91fcde4b-a7db-4960-a293-e153ef8dc7d9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:21.844307 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-91fcde4b-a7db-4960-a293-e153ef8dc7d9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:21.844963 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-91fcde4b-a7db-4960-a293-e153ef8dc7d9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:21.845781 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-91fcde4b-a7db-4960-a293-e153ef8dc7d9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:22.055794 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:22.219085 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-91fcde4b-a7db-4960-a293-e153ef8dc7d9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:22.236330 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-91fcde4b-a7db-4960-a293-e153ef8dc7d9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1362 microversion: 2.1 time: 0.418213 Aug 17 08:38:22.238038 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 41/71] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:21 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1362 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:22.247122 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-24110e67-ea62-4192-82c9-a74764de29fa tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:22.248235 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-24110e67-ea62-4192-82c9-a74764de29fa tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:22.265075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-24110e67-ea62-4192-82c9-a74764de29fa tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:22.266249 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-24110e67-ea62-4192-82c9-a74764de29fa tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:22.267113 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-24110e67-ea62-4192-82c9-a74764de29fa tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:22.268396 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-24110e67-ea62-4192-82c9-a74764de29fa tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:22.270435 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-24110e67-ea62-4192-82c9-a74764de29fa tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:22.271779 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-24110e67-ea62-4192-82c9-a74764de29fa tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:22.487636 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2f17f738-4c61-4892-9f87-51b54372f5b8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:22.496498 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2f17f738-4c61-4892-9f87-51b54372f5b8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1320 microversion: 2.1 time: 1.080570 Aug 17 08:38:22.503455 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 31/72] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:21 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1320 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:22.537293 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-24110e67-ea62-4192-82c9-a74764de29fa tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:22.553628 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-24110e67-ea62-4192-82c9-a74764de29fa tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1314 microversion: 2.1 time: 0.312373 Aug 17 08:38:22.554234 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 42/73] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:22 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:23.259230 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-db4b9124-a82f-4ce0-be94-502020ee6b03 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:23.260072 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-db4b9124-a82f-4ce0-be94-502020ee6b03 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:23.267934 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-db4b9124-a82f-4ce0-be94-502020ee6b03 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:23.268513 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-db4b9124-a82f-4ce0-be94-502020ee6b03 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:23.268913 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-db4b9124-a82f-4ce0-be94-502020ee6b03 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:23.274594 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-db4b9124-a82f-4ce0-be94-502020ee6b03 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:23.275375 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-db4b9124-a82f-4ce0-be94-502020ee6b03 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:23.276036 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-db4b9124-a82f-4ce0-be94-502020ee6b03 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:23.461031 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-db4b9124-a82f-4ce0-be94-502020ee6b03 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:23.471977 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-db4b9124-a82f-4ce0-be94-502020ee6b03 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1362 microversion: 2.1 time: 0.214900 Aug 17 08:38:23.472907 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 32/74] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:23 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:38:23.523873 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5b5c3bf6-8d59-4c6d-bc55-295e9346e559 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:23.524618 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-5b5c3bf6-8d59-4c6d-bc55-295e9346e559 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:23.537325 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5b5c3bf6-8d59-4c6d-bc55-295e9346e559 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:23.537736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5b5c3bf6-8d59-4c6d-bc55-295e9346e559 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:23.538169 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5b5c3bf6-8d59-4c6d-bc55-295e9346e559 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:23.543617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5b5c3bf6-8d59-4c6d-bc55-295e9346e559 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:23.548218 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5b5c3bf6-8d59-4c6d-bc55-295e9346e559 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:23.549340 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5b5c3bf6-8d59-4c6d-bc55-295e9346e559 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:23.573673 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d23b1175-ff0a-4102-8a71-abe4eb226370 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:23.574306 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d23b1175-ff0a-4102-8a71-abe4eb226370 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:23.583966 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d23b1175-ff0a-4102-8a71-abe4eb226370 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:23.584600 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d23b1175-ff0a-4102-8a71-abe4eb226370 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:23.585040 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d23b1175-ff0a-4102-8a71-abe4eb226370 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:23.586943 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d23b1175-ff0a-4102-8a71-abe4eb226370 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:23.587422 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d23b1175-ff0a-4102-8a71-abe4eb226370 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:23.589251 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d23b1175-ff0a-4102-8a71-abe4eb226370 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:24.020816 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-5b5c3bf6-8d59-4c6d-bc55-295e9346e559 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:24.031241 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-5b5c3bf6-8d59-4c6d-bc55-295e9346e559 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1320 microversion: 2.1 time: 0.512582 Aug 17 08:38:24.040038 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 43/75] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:23 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1320 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:24.153375 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-d23b1175-ff0a-4102-8a71-abe4eb226370 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:24.162899 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d23b1175-ff0a-4102-8a71-abe4eb226370 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1314 microversion: 2.1 time: 0.593083 Aug 17 08:38:24.169959 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 33/76] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:23 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:38:24.497866 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2cfd9f3d-5aca-4d48-a172-4eaccc9d72aa tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:24.498934 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-2cfd9f3d-5aca-4d48-a172-4eaccc9d72aa tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:24.501203 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:24.502493 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:24.514265 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2cfd9f3d-5aca-4d48-a172-4eaccc9d72aa tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:24.516362 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2cfd9f3d-5aca-4d48-a172-4eaccc9d72aa tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:24.519676 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2cfd9f3d-5aca-4d48-a172-4eaccc9d72aa tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:24.520571 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2cfd9f3d-5aca-4d48-a172-4eaccc9d72aa tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:24.521287 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2cfd9f3d-5aca-4d48-a172-4eaccc9d72aa tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:24.523273 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2cfd9f3d-5aca-4d48-a172-4eaccc9d72aa tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:24.949638 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-2cfd9f3d-5aca-4d48-a172-4eaccc9d72aa tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:24.976297 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2cfd9f3d-5aca-4d48-a172-4eaccc9d72aa tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1362 microversion: 2.1 time: 0.474944 Aug 17 08:38:24.980801 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 44/77] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:24 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1362 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:25.055870 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-4279f269-3c04-4ca6-8755-d3b4612008d0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:25.058023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-4279f269-3c04-4ca6-8755-d3b4612008d0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:25.067688 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4279f269-3c04-4ca6-8755-d3b4612008d0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:25.068542 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4279f269-3c04-4ca6-8755-d3b4612008d0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:25.069203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4279f269-3c04-4ca6-8755-d3b4612008d0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:25.071096 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4279f269-3c04-4ca6-8755-d3b4612008d0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:25.073929 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4279f269-3c04-4ca6-8755-d3b4612008d0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:25.075235 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4279f269-3c04-4ca6-8755-d3b4612008d0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:25.190545 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8ae23810-877b-404b-a891-28996e3ef81e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:25.192230 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8ae23810-877b-404b-a891-28996e3ef81e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:25.204558 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8ae23810-877b-404b-a891-28996e3ef81e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:25.205959 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8ae23810-877b-404b-a891-28996e3ef81e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:25.208182 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8ae23810-877b-404b-a891-28996e3ef81e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:25.211387 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8ae23810-877b-404b-a891-28996e3ef81e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:25.212197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8ae23810-877b-404b-a891-28996e3ef81e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:25.215010 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8ae23810-877b-404b-a891-28996e3ef81e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:25.643219 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8ae23810-877b-404b-a891-28996e3ef81e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:25.651477 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8ae23810-877b-404b-a891-28996e3ef81e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1314 microversion: 2.1 time: 0.465246 Aug 17 08:38:25.653157 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 45/78] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:25 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:38:25.662285 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-4279f269-3c04-4ca6-8755-d3b4612008d0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:25.672917 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-4279f269-3c04-4ca6-8755-d3b4612008d0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1320 microversion: 2.1 time: 0.622452 Aug 17 08:38:25.674257 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 34/79] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:25 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1320 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:38:26.001211 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-51d31a8f-b005-46a6-8f3e-22af67698659 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:26.001911 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-51d31a8f-b005-46a6-8f3e-22af67698659 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:26.009196 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-51d31a8f-b005-46a6-8f3e-22af67698659 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:26.009694 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-51d31a8f-b005-46a6-8f3e-22af67698659 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:26.010117 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-51d31a8f-b005-46a6-8f3e-22af67698659 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:26.010834 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-51d31a8f-b005-46a6-8f3e-22af67698659 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:26.011337 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-51d31a8f-b005-46a6-8f3e-22af67698659 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:26.011859 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-51d31a8f-b005-46a6-8f3e-22af67698659 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:26.203369 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-51d31a8f-b005-46a6-8f3e-22af67698659 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:26.212533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-51d31a8f-b005-46a6-8f3e-22af67698659 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1362 microversion: 2.1 time: 0.215797 Aug 17 08:38:26.213206 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 46/80] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:25 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:26.674484 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8c92d84b-cbc2-4a3f-b017-ca80abd6d641 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:26.675272 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8c92d84b-cbc2-4a3f-b017-ca80abd6d641 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:26.686831 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8c92d84b-cbc2-4a3f-b017-ca80abd6d641 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:26.695236 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-cb5024b0-b2df-4e79-a0b3-6d9bdebf8d15 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:26.696188 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-cb5024b0-b2df-4e79-a0b3-6d9bdebf8d15 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:26.700057 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8c92d84b-cbc2-4a3f-b017-ca80abd6d641 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:26.702620 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8c92d84b-cbc2-4a3f-b017-ca80abd6d641 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:26.704626 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8c92d84b-cbc2-4a3f-b017-ca80abd6d641 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:26.707927 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8c92d84b-cbc2-4a3f-b017-ca80abd6d641 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:26.709419 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8c92d84b-cbc2-4a3f-b017-ca80abd6d641 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:26.710648 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cb5024b0-b2df-4e79-a0b3-6d9bdebf8d15 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:26.713220 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cb5024b0-b2df-4e79-a0b3-6d9bdebf8d15 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:26.714644 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cb5024b0-b2df-4e79-a0b3-6d9bdebf8d15 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:26.717107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cb5024b0-b2df-4e79-a0b3-6d9bdebf8d15 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:26.719167 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cb5024b0-b2df-4e79-a0b3-6d9bdebf8d15 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:26.719929 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cb5024b0-b2df-4e79-a0b3-6d9bdebf8d15 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:27.139675 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-cb5024b0-b2df-4e79-a0b3-6d9bdebf8d15 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:27.156248 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8c92d84b-cbc2-4a3f-b017-ca80abd6d641 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:27.165460 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8c92d84b-cbc2-4a3f-b017-ca80abd6d641 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1314 microversion: 2.1 time: 0.495404 Aug 17 08:38:27.166036 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 35/81] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:26 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:27.178488 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-cb5024b0-b2df-4e79-a0b3-6d9bdebf8d15 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1320 microversion: 2.1 time: 0.460874 Aug 17 08:38:27.180669 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 47/82] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:26 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1320 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:27.233722 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ad05c92e-8f77-4c56-b73a-5005088ce056 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:27.234333 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ad05c92e-8f77-4c56-b73a-5005088ce056 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:27.241136 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ad05c92e-8f77-4c56-b73a-5005088ce056 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:27.241631 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ad05c92e-8f77-4c56-b73a-5005088ce056 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:27.242385 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ad05c92e-8f77-4c56-b73a-5005088ce056 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:27.243088 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ad05c92e-8f77-4c56-b73a-5005088ce056 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:27.243562 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ad05c92e-8f77-4c56-b73a-5005088ce056 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:27.247392 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ad05c92e-8f77-4c56-b73a-5005088ce056 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:27.464378 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ad05c92e-8f77-4c56-b73a-5005088ce056 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:27.472867 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ad05c92e-8f77-4c56-b73a-5005088ce056 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1362 microversion: 2.1 time: 0.242060 Aug 17 08:38:27.473456 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 36/83] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:27 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:27.744957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-9cf9a8a0-544f-4f3d-ab24-951a299f9a30 req-c178a1a5-a757-4596-88d8-43cd4309be34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acc7affb-d8db-4d51-a10a-95235ce04aa3", "name": "network-vif-plugged", "status": "completed", "tag": "9df79908-9527-4436-9dcf-41c6d5696780"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:38:27.768880 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-9cf9a8a0-544f-4f3d-ab24-951a299f9a30 req-c178a1a5-a757-4596-88d8-43cd4309be34 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:27.770320 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-9cf9a8a0-544f-4f3d-ab24-951a299f9a30 req-c178a1a5-a757-4596-88d8-43cd4309be34 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:27.771640 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-9cf9a8a0-544f-4f3d-ab24-951a299f9a30 req-c178a1a5-a757-4596-88d8-43cd4309be34 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:27.788421 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-9cf9a8a0-544f-4f3d-ab24-951a299f9a30 req-c178a1a5-a757-4596-88d8-43cd4309be34 service nova] Creating event network-vif-plugged:9df79908-9527-4436-9dcf-41c6d5696780 for instance acc7affb-d8db-4d51-a10a-95235ce04aa3 on hv-cinder-85331 Aug 17 08:38:27.794139 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-9cf9a8a0-544f-4f3d-ab24-951a299f9a30 req-c178a1a5-a757-4596-88d8-43cd4309be34 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.343996 Aug 17 08:38:27.795383 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 48/84] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:38:28.193619 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6699c7ae-ec40-49f5-8d1c-0d20af3d5fa9 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:28.196143 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-afa17503-aaf5-4aa6-8ea7-195a7f87b44f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:28.197811 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6699c7ae-ec40-49f5-8d1c-0d20af3d5fa9 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:28.199632 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-afa17503-aaf5-4aa6-8ea7-195a7f87b44f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:28.210125 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6699c7ae-ec40-49f5-8d1c-0d20af3d5fa9 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:28.210807 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6699c7ae-ec40-49f5-8d1c-0d20af3d5fa9 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:28.211362 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6699c7ae-ec40-49f5-8d1c-0d20af3d5fa9 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:28.216862 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6699c7ae-ec40-49f5-8d1c-0d20af3d5fa9 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:28.218400 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6699c7ae-ec40-49f5-8d1c-0d20af3d5fa9 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:28.218744 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-afa17503-aaf5-4aa6-8ea7-195a7f87b44f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:28.218889 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6699c7ae-ec40-49f5-8d1c-0d20af3d5fa9 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:28.219517 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-afa17503-aaf5-4aa6-8ea7-195a7f87b44f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:28.220248 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-afa17503-aaf5-4aa6-8ea7-195a7f87b44f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:28.221226 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-afa17503-aaf5-4aa6-8ea7-195a7f87b44f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:28.221686 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-afa17503-aaf5-4aa6-8ea7-195a7f87b44f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:28.222181 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-afa17503-aaf5-4aa6-8ea7-195a7f87b44f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:28.261968 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=100 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:28.475042 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-afa17503-aaf5-4aa6-8ea7-195a7f87b44f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:28.490541 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-afa17503-aaf5-4aa6-8ea7-195a7f87b44f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1320 microversion: 2.1 time: 0.301373 Aug 17 08:38:28.491985 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 49/85] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:28 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1320 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:28.502735 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2e8cebb9-3406-47c8-9d5c-ae5c6e79e6a6 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:28.503332 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-2e8cebb9-3406-47c8-9d5c-ae5c6e79e6a6 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:28.517163 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2e8cebb9-3406-47c8-9d5c-ae5c6e79e6a6 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:28.517662 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2e8cebb9-3406-47c8-9d5c-ae5c6e79e6a6 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:28.518232 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2e8cebb9-3406-47c8-9d5c-ae5c6e79e6a6 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:28.519116 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2e8cebb9-3406-47c8-9d5c-ae5c6e79e6a6 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:28.520057 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2e8cebb9-3406-47c8-9d5c-ae5c6e79e6a6 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:28.520634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2e8cebb9-3406-47c8-9d5c-ae5c6e79e6a6 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:28.616983 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6699c7ae-ec40-49f5-8d1c-0d20af3d5fa9 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:28.625109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6699c7ae-ec40-49f5-8d1c-0d20af3d5fa9 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1314 microversion: 2.1 time: 0.442751 Aug 17 08:38:28.628279 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 37/86] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:28 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:38:28.857834 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-2e8cebb9-3406-47c8-9d5c-ae5c6e79e6a6 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:28.866762 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2e8cebb9-3406-47c8-9d5c-ae5c6e79e6a6 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1362 microversion: 2.1 time: 0.373739 Aug 17 08:38:28.867340 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 50/87] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:28 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1362 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:29.517116 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-613ff7d2-ac94-4e4a-8c0a-81f29a3b1c12 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:29.518073 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-613ff7d2-ac94-4e4a-8c0a-81f29a3b1c12 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:29.533893 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-613ff7d2-ac94-4e4a-8c0a-81f29a3b1c12 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:29.534968 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-613ff7d2-ac94-4e4a-8c0a-81f29a3b1c12 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:29.550367 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-613ff7d2-ac94-4e4a-8c0a-81f29a3b1c12 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:29.552043 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-613ff7d2-ac94-4e4a-8c0a-81f29a3b1c12 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:29.553989 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-613ff7d2-ac94-4e4a-8c0a-81f29a3b1c12 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:29.554639 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-613ff7d2-ac94-4e4a-8c0a-81f29a3b1c12 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:29.648486 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-fd3c0343-a660-4b5a-a6ca-4a65d36829de tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:29.649111 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fd3c0343-a660-4b5a-a6ca-4a65d36829de tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:29.674672 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fd3c0343-a660-4b5a-a6ca-4a65d36829de tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:29.676153 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fd3c0343-a660-4b5a-a6ca-4a65d36829de tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:29.676727 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fd3c0343-a660-4b5a-a6ca-4a65d36829de tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:29.677634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fd3c0343-a660-4b5a-a6ca-4a65d36829de tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:29.678961 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fd3c0343-a660-4b5a-a6ca-4a65d36829de tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:29.679558 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fd3c0343-a660-4b5a-a6ca-4a65d36829de tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:29.859801 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-613ff7d2-ac94-4e4a-8c0a-81f29a3b1c12 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:29.873568 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-613ff7d2-ac94-4e4a-8c0a-81f29a3b1c12 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1320 microversion: 2.1 time: 0.362252 Aug 17 08:38:29.874993 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 38/88] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:29 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1320 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:29.891530 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-c3264567-68ce-4e06-bd58-63de09b62324 req-2bb75947-75d0-4f8a-9ef4-63bbcb8f3bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eefed036-89ed-46ed-8d8d-ab6b8a9abfce", "name": "network-vif-plugged", "status": "completed", "tag": "88ccd260-6726-4fd3-b8cd-7a065527f5cb"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:38:29.915381 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-c3264567-68ce-4e06-bd58-63de09b62324 req-2bb75947-75d0-4f8a-9ef4-63bbcb8f3bb7 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:29.915942 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-c3264567-68ce-4e06-bd58-63de09b62324 req-2bb75947-75d0-4f8a-9ef4-63bbcb8f3bb7 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:29.916308 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-c3264567-68ce-4e06-bd58-63de09b62324 req-2bb75947-75d0-4f8a-9ef4-63bbcb8f3bb7 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:29.938520 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-c3264567-68ce-4e06-bd58-63de09b62324 req-2bb75947-75d0-4f8a-9ef4-63bbcb8f3bb7 service nova] Creating event network-vif-plugged:88ccd260-6726-4fd3-b8cd-7a065527f5cb for instance eefed036-89ed-46ed-8d8d-ab6b8a9abfce on hv-cinder-85331 Aug 17 08:38:29.957426 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-c3264567-68ce-4e06-bd58-63de09b62324 req-2bb75947-75d0-4f8a-9ef4-63bbcb8f3bb7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079418 Aug 17 08:38:29.959315 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 39/89] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:38:29.966803 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-331b9f87-c548-4595-851d-05e813e45afc tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:29.967775 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-331b9f87-c548-4595-851d-05e813e45afc tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:29.983260 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-331b9f87-c548-4595-851d-05e813e45afc tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:29.986735 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-331b9f87-c548-4595-851d-05e813e45afc tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:29.987470 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-331b9f87-c548-4595-851d-05e813e45afc tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:29.989289 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-331b9f87-c548-4595-851d-05e813e45afc tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:29.991661 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-331b9f87-c548-4595-851d-05e813e45afc tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:29.993307 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-331b9f87-c548-4595-851d-05e813e45afc tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:30.031638 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-fd3c0343-a660-4b5a-a6ca-4a65d36829de tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:30.040278 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-fd3c0343-a660-4b5a-a6ca-4a65d36829de tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1314 microversion: 2.1 time: 0.395817 Aug 17 08:38:30.040862 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 51/90] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:29 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:30.296527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-331b9f87-c548-4595-851d-05e813e45afc tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:30.305676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-331b9f87-c548-4595-851d-05e813e45afc tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1362 microversion: 2.1 time: 0.344800 Aug 17 08:38:30.306272 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 40/91] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:29 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:30.899507 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7769f495-b2f3-4d7c-978d-8d7c43231107 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:30.900132 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7769f495-b2f3-4d7c-978d-8d7c43231107 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:30.907697 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7769f495-b2f3-4d7c-978d-8d7c43231107 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:30.908178 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7769f495-b2f3-4d7c-978d-8d7c43231107 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:30.909914 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7769f495-b2f3-4d7c-978d-8d7c43231107 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:30.911267 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7769f495-b2f3-4d7c-978d-8d7c43231107 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:30.912555 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7769f495-b2f3-4d7c-978d-8d7c43231107 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:30.912993 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7769f495-b2f3-4d7c-978d-8d7c43231107 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:31.061730 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-aaac5666-cd22-41e7-8ec8-a4f677d759c5 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:31.062489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-aaac5666-cd22-41e7-8ec8-a4f677d759c5 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:31.070010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-aaac5666-cd22-41e7-8ec8-a4f677d759c5 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:31.072664 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-aaac5666-cd22-41e7-8ec8-a4f677d759c5 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:31.074419 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-aaac5666-cd22-41e7-8ec8-a4f677d759c5 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:31.076313 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-aaac5666-cd22-41e7-8ec8-a4f677d759c5 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:31.076881 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-aaac5666-cd22-41e7-8ec8-a4f677d759c5 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:31.080237 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-aaac5666-cd22-41e7-8ec8-a4f677d759c5 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:31.295021 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-7769f495-b2f3-4d7c-978d-8d7c43231107 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:31.304452 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-7769f495-b2f3-4d7c-978d-8d7c43231107 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1320 microversion: 2.1 time: 0.409207 Aug 17 08:38:31.309800 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 52/92] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:30 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1320 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:31.328606 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e1b3a742-6e8b-432a-afce-64d352b1351b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:31.330220 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e1b3a742-6e8b-432a-afce-64d352b1351b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:31.341240 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e1b3a742-6e8b-432a-afce-64d352b1351b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:31.341994 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e1b3a742-6e8b-432a-afce-64d352b1351b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:31.343047 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e1b3a742-6e8b-432a-afce-64d352b1351b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:31.344068 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e1b3a742-6e8b-432a-afce-64d352b1351b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:31.344696 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e1b3a742-6e8b-432a-afce-64d352b1351b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:31.345398 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e1b3a742-6e8b-432a-afce-64d352b1351b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:31.354507 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-aaac5666-cd22-41e7-8ec8-a4f677d759c5 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:31.370596 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-aaac5666-cd22-41e7-8ec8-a4f677d759c5 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1500 microversion: 2.1 time: 0.307933 Aug 17 08:38:31.379624 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 41/93] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:31 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1500 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:31.655663 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e1b3a742-6e8b-432a-afce-64d352b1351b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:31.665697 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e1b3a742-6e8b-432a-afce-64d352b1351b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1362 microversion: 2.1 time: 0.341557 Aug 17 08:38:31.666309 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 53/94] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:31 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1362 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:38:31.977955 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-74cac402-e80a-462c-98e1-84f94c851e84 req-bcd3473a-475c-441a-9b40-f59ecc55cc4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcce3821-0099-45bc-9283-1ad5632080ce", "name": "network-vif-plugged", "status": "completed", "tag": "8843e2b2-9e74-4082-acb6-0b36b20085b1"}, {"server_uuid": "c224c091-7aa6-49a0-b269-a833010f6cc9", "name": "network-vif-plugged", "status": "completed", "tag": "6b201d95-6d5e-4e67-84ac-5b8cfa9080cd"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:38:32.001729 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-74cac402-e80a-462c-98e1-84f94c851e84 req-bcd3473a-475c-441a-9b40-f59ecc55cc4b service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:32.002218 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-74cac402-e80a-462c-98e1-84f94c851e84 req-bcd3473a-475c-441a-9b40-f59ecc55cc4b service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:32.002972 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-74cac402-e80a-462c-98e1-84f94c851e84 req-bcd3473a-475c-441a-9b40-f59ecc55cc4b service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:32.036468 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-74cac402-e80a-462c-98e1-84f94c851e84 req-bcd3473a-475c-441a-9b40-f59ecc55cc4b service nova] Creating event network-vif-plugged:8843e2b2-9e74-4082-acb6-0b36b20085b1 for instance fcce3821-0099-45bc-9283-1ad5632080ce on hv-cinder-85331 Aug 17 08:38:32.038915 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-74cac402-e80a-462c-98e1-84f94c851e84 req-bcd3473a-475c-441a-9b40-f59ecc55cc4b service nova] Creating event network-vif-plugged:6b201d95-6d5e-4e67-84ac-5b8cfa9080cd for instance c224c091-7aa6-49a0-b269-a833010f6cc9 on hv-cinder-85331 Aug 17 08:38:32.053036 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-74cac402-e80a-462c-98e1-84f94c851e84 req-bcd3473a-475c-441a-9b40-f59ecc55cc4b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.075727 Aug 17 08:38:32.053658 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 42/95] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:38:32.329736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8989383e-7f19-4c13-934a-c8ca3d4ae539 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:32.330338 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8989383e-7f19-4c13-934a-c8ca3d4ae539 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:32.339217 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8989383e-7f19-4c13-934a-c8ca3d4ae539 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:32.340126 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8989383e-7f19-4c13-934a-c8ca3d4ae539 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:32.340771 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8989383e-7f19-4c13-934a-c8ca3d4ae539 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:32.341910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8989383e-7f19-4c13-934a-c8ca3d4ae539 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:32.342682 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8989383e-7f19-4c13-934a-c8ca3d4ae539 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:32.343427 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8989383e-7f19-4c13-934a-c8ca3d4ae539 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:32.513641 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8989383e-7f19-4c13-934a-c8ca3d4ae539 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:32.522950 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8989383e-7f19-4c13-934a-c8ca3d4ae539 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1514 microversion: 2.1 time: 0.200293 Aug 17 08:38:32.536336 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 54/96] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:32 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1514 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:38:32.555652 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-35d9037b-fcba-4231-8d0f-558920b8df84 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:38:32.558098 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-35d9037b-fcba-4231-8d0f-558920b8df84 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:32.573273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-35d9037b-fcba-4231-8d0f-558920b8df84 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:32.574032 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-35d9037b-fcba-4231-8d0f-558920b8df84 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:32.574689 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-35d9037b-fcba-4231-8d0f-558920b8df84 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:32.576323 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-35d9037b-fcba-4231-8d0f-558920b8df84 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:32.576987 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-35d9037b-fcba-4231-8d0f-558920b8df84 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:32.579946 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-35d9037b-fcba-4231-8d0f-558920b8df84 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:32.656459 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-35d9037b-fcba-4231-8d0f-558920b8df84 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lazy-loading 'flavor' on Instance uuid eefed036-89ed-46ed-8d8d-ab6b8a9abfce {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:38:32.691012 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-43ddbb05-4091-4ccd-af49-166ccf491d5b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:32.691935 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-43ddbb05-4091-4ccd-af49-166ccf491d5b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:32.702518 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-43ddbb05-4091-4ccd-af49-166ccf491d5b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:32.703621 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-43ddbb05-4091-4ccd-af49-166ccf491d5b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:32.705434 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-43ddbb05-4091-4ccd-af49-166ccf491d5b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:32.708110 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-43ddbb05-4091-4ccd-af49-166ccf491d5b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:32.709396 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-43ddbb05-4091-4ccd-af49-166ccf491d5b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:32.710249 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-43ddbb05-4091-4ccd-af49-166ccf491d5b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:32.813741 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:32.827131 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-35d9037b-fcba-4231-8d0f-558920b8df84 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "POST /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce/action" status: 200 len: 32 microversion: 2.1 time: 0.283560 Aug 17 08:38:32.827966 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 43/97] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 08:38:32 2022] POST /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce/action => generated 32 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 08:38:32.841408 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-bc2794a0-0cb6-4f37-a301-d7ed5047afc7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:32.842531 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-bc2794a0-0cb6-4f37-a301-d7ed5047afc7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:32.850702 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc2794a0-0cb6-4f37-a301-d7ed5047afc7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:32.851974 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc2794a0-0cb6-4f37-a301-d7ed5047afc7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:32.852749 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc2794a0-0cb6-4f37-a301-d7ed5047afc7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:32.853687 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc2794a0-0cb6-4f37-a301-d7ed5047afc7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:32.854372 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc2794a0-0cb6-4f37-a301-d7ed5047afc7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:32.855108 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc2794a0-0cb6-4f37-a301-d7ed5047afc7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:32.881596 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-43ddbb05-4091-4ccd-af49-166ccf491d5b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:32.890814 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-43ddbb05-4091-4ccd-af49-166ccf491d5b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1362 microversion: 2.1 time: 0.205427 Aug 17 08:38:32.891967 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 55/98] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:32 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:33.015066 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-bc2794a0-0cb6-4f37-a301-d7ed5047afc7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:33.025046 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-bc2794a0-0cb6-4f37-a301-d7ed5047afc7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.187897 Aug 17 08:38:33.026253 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 44/99] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:32 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:33.134110 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-85ba8403-0d76-4be1-8a36-c65a525a5c6b tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aed55f11-8f63-454c-b21c-f48bfb1b0308"}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:38:33.137425 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-85ba8403-0d76-4be1-8a36-c65a525a5c6b tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:33.144199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-85ba8403-0d76-4be1-8a36-c65a525a5c6b tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:33.146298 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-85ba8403-0d76-4be1-8a36-c65a525a5c6b tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:33.146992 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-85ba8403-0d76-4be1-8a36-c65a525a5c6b tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:33.148909 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-85ba8403-0d76-4be1-8a36-c65a525a5c6b tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:33.149387 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-85ba8403-0d76-4be1-8a36-c65a525a5c6b tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:33.149810 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-85ba8403-0d76-4be1-8a36-c65a525a5c6b tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:33.912742 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-54fa4788-ec75-41da-9b9e-a4ec485e3ad1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:33.913889 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-54fa4788-ec75-41da-9b9e-a4ec485e3ad1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:33.926629 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-54fa4788-ec75-41da-9b9e-a4ec485e3ad1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:33.927534 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-54fa4788-ec75-41da-9b9e-a4ec485e3ad1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:33.928645 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-54fa4788-ec75-41da-9b9e-a4ec485e3ad1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:33.929617 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-54fa4788-ec75-41da-9b9e-a4ec485e3ad1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:33.930225 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-54fa4788-ec75-41da-9b9e-a4ec485e3ad1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:33.930748 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-54fa4788-ec75-41da-9b9e-a4ec485e3ad1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:34.184680 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-54fa4788-ec75-41da-9b9e-a4ec485e3ad1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:34.194007 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-54fa4788-ec75-41da-9b9e-a4ec485e3ad1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1362 microversion: 2.1 time: 0.285679 Aug 17 08:38:34.195156 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 45/100] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:33 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:38:34.200657 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-bdaf9d76-94a1-4613-9c2e-f5ea1c2fed69 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:34.201454 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-bdaf9d76-94a1-4613-9c2e-f5ea1c2fed69 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:34.214666 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bdaf9d76-94a1-4613-9c2e-f5ea1c2fed69 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:34.215612 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bdaf9d76-94a1-4613-9c2e-f5ea1c2fed69 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:34.219179 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bdaf9d76-94a1-4613-9c2e-f5ea1c2fed69 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:34.220325 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bdaf9d76-94a1-4613-9c2e-f5ea1c2fed69 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:34.221011 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bdaf9d76-94a1-4613-9c2e-f5ea1c2fed69 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:34.222546 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bdaf9d76-94a1-4613-9c2e-f5ea1c2fed69 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:34.514885 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-bdaf9d76-94a1-4613-9c2e-f5ea1c2fed69 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:34.526429 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-bdaf9d76-94a1-4613-9c2e-f5ea1c2fed69 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.329773 Aug 17 08:38:34.540563 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 46/101] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:34 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:35.216865 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1a214435-5f24-460c-9cf7-8a276a7aebd9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:35.218483 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1a214435-5f24-460c-9cf7-8a276a7aebd9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:35.229286 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1a214435-5f24-460c-9cf7-8a276a7aebd9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:35.229772 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1a214435-5f24-460c-9cf7-8a276a7aebd9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:35.230199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1a214435-5f24-460c-9cf7-8a276a7aebd9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:35.230890 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1a214435-5f24-460c-9cf7-8a276a7aebd9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:35.231396 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1a214435-5f24-460c-9cf7-8a276a7aebd9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:35.231770 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1a214435-5f24-460c-9cf7-8a276a7aebd9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:35.467701 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-85ba8403-0d76-4be1-8a36-c65a525a5c6b tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "POST /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.337197 Aug 17 08:38:35.469134 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 56/102] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 08:38:33 2022] POST /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3/os-volume_attachments => generated 194 bytes in 2340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:38:35.498842 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1a214435-5f24-460c-9cf7-8a276a7aebd9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:35.510954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1a214435-5f24-460c-9cf7-8a276a7aebd9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1548 microversion: 2.1 time: 0.298321 Aug 17 08:38:35.512407 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 47/103] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:35 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1548 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:38:35.533303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f3d2f125-ea7d-4391-9c22-9487a2cbe0df tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:35.534739 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f3d2f125-ea7d-4391-9c22-9487a2cbe0df tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:35.548239 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f3d2f125-ea7d-4391-9c22-9487a2cbe0df tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:35.548239 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f3d2f125-ea7d-4391-9c22-9487a2cbe0df tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:35.548239 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f3d2f125-ea7d-4391-9c22-9487a2cbe0df tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:35.548239 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f3d2f125-ea7d-4391-9c22-9487a2cbe0df tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:35.548603 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f3d2f125-ea7d-4391-9c22-9487a2cbe0df tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:35.548603 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f3d2f125-ea7d-4391-9c22-9487a2cbe0df tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:35.556202 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2a35f26d-4c2a-4f66-8213-59efc8881b90 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:35.556801 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2a35f26d-4c2a-4f66-8213-59efc8881b90 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:35.562760 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2a35f26d-4c2a-4f66-8213-59efc8881b90 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:35.563246 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2a35f26d-4c2a-4f66-8213-59efc8881b90 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:35.563688 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2a35f26d-4c2a-4f66-8213-59efc8881b90 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:35.564368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2a35f26d-4c2a-4f66-8213-59efc8881b90 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:35.564808 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2a35f26d-4c2a-4f66-8213-59efc8881b90 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:35.565219 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2a35f26d-4c2a-4f66-8213-59efc8881b90 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:35.683141 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f3d2f125-ea7d-4391-9c22-9487a2cbe0df tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.154453 Aug 17 08:38:35.683754 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 57/104] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 17 08:38:35 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9/os-interface => generated 285 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:38:36.105822 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2a35f26d-4c2a-4f66-8213-59efc8881b90 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:36.113455 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2a35f26d-4c2a-4f66-8213-59efc8881b90 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.561594 Aug 17 08:38:36.114020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 48/105] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:35 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:37.124743 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-d9ac26df-8c14-44db-bfab-0f1a4892d378 req-4fb8fcfc-136f-4e6e-93bb-93a93629e39c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c224c091-7aa6-49a0-b269-a833010f6cc9", "tag": "6b201d95-6d5e-4e67-84ac-5b8cfa9080cd"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:38:37.134530 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-afe611a3-c13f-4b28-a3bb-ba990cd3f4b0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:37.135203 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-d9ac26df-8c14-44db-bfab-0f1a4892d378 req-4fb8fcfc-136f-4e6e-93bb-93a93629e39c service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:37.135703 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-d9ac26df-8c14-44db-bfab-0f1a4892d378 req-4fb8fcfc-136f-4e6e-93bb-93a93629e39c service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:37.136379 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-d9ac26df-8c14-44db-bfab-0f1a4892d378 req-4fb8fcfc-136f-4e6e-93bb-93a93629e39c service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:37.137441 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-afe611a3-c13f-4b28-a3bb-ba990cd3f4b0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:37.146852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-afe611a3-c13f-4b28-a3bb-ba990cd3f4b0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:37.148619 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-d9ac26df-8c14-44db-bfab-0f1a4892d378 req-4fb8fcfc-136f-4e6e-93bb-93a93629e39c service nova] Creating event network-changed:6b201d95-6d5e-4e67-84ac-5b8cfa9080cd for instance c224c091-7aa6-49a0-b269-a833010f6cc9 on hv-cinder-85331 Aug 17 08:38:37.148744 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-afe611a3-c13f-4b28-a3bb-ba990cd3f4b0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:37.150143 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-afe611a3-c13f-4b28-a3bb-ba990cd3f4b0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:37.153562 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-d9ac26df-8c14-44db-bfab-0f1a4892d378 req-4fb8fcfc-136f-4e6e-93bb-93a93629e39c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034887 Aug 17 08:38:37.154407 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 58/106] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:38:37.155927 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-afe611a3-c13f-4b28-a3bb-ba990cd3f4b0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:37.156451 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-afe611a3-c13f-4b28-a3bb-ba990cd3f4b0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:37.156890 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-afe611a3-c13f-4b28-a3bb-ba990cd3f4b0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:37.303206 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-afe611a3-c13f-4b28-a3bb-ba990cd3f4b0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:37.312221 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-afe611a3-c13f-4b28-a3bb-ba990cd3f4b0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.181822 Aug 17 08:38:37.312809 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 49/107] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:37 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:38:38.338190 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f2d044e5-2186-4348-bc6d-5f84ee91974f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:38.343031 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f2d044e5-2186-4348-bc6d-5f84ee91974f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:38.359248 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f2d044e5-2186-4348-bc6d-5f84ee91974f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:38.360650 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f2d044e5-2186-4348-bc6d-5f84ee91974f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:38.363625 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f2d044e5-2186-4348-bc6d-5f84ee91974f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:38.364460 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f2d044e5-2186-4348-bc6d-5f84ee91974f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:38.365021 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f2d044e5-2186-4348-bc6d-5f84ee91974f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:38.367779 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f2d044e5-2186-4348-bc6d-5f84ee91974f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:38.570042 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-f2d044e5-2186-4348-bc6d-5f84ee91974f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:38.579181 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f2d044e5-2186-4348-bc6d-5f84ee91974f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.249804 Aug 17 08:38:38.593899 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 59/108] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:38 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:39.601461 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6be94eab-32af-40bb-8bc5-d337339f65c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:39.602103 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6be94eab-32af-40bb-8bc5-d337339f65c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:39.608200 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6be94eab-32af-40bb-8bc5-d337339f65c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:39.608917 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6be94eab-32af-40bb-8bc5-d337339f65c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:39.609358 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6be94eab-32af-40bb-8bc5-d337339f65c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:39.610044 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6be94eab-32af-40bb-8bc5-d337339f65c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:39.610580 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6be94eab-32af-40bb-8bc5-d337339f65c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:39.610874 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6be94eab-32af-40bb-8bc5-d337339f65c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:39.746058 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6be94eab-32af-40bb-8bc5-d337339f65c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:39.754449 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6be94eab-32af-40bb-8bc5-d337339f65c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.156807 Aug 17 08:38:39.755023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 50/109] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:39 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:40.775173 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f1c50b47-c8a9-4f5d-b309-b6183a703f68 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:40.775796 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f1c50b47-c8a9-4f5d-b309-b6183a703f68 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:40.782194 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f1c50b47-c8a9-4f5d-b309-b6183a703f68 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:40.782669 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f1c50b47-c8a9-4f5d-b309-b6183a703f68 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:40.783097 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f1c50b47-c8a9-4f5d-b309-b6183a703f68 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:40.784344 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f1c50b47-c8a9-4f5d-b309-b6183a703f68 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:40.784792 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f1c50b47-c8a9-4f5d-b309-b6183a703f68 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:40.785211 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f1c50b47-c8a9-4f5d-b309-b6183a703f68 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:40.916159 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-f1c50b47-c8a9-4f5d-b309-b6183a703f68 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:40.923520 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f1c50b47-c8a9-4f5d-b309-b6183a703f68 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.152159 Aug 17 08:38:40.924097 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 60/110] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:40 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:41.944589 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-73c503f6-8ee1-4bfb-ac0a-24ee60ea2b07 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:41.945271 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-73c503f6-8ee1-4bfb-ac0a-24ee60ea2b07 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:41.951267 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-73c503f6-8ee1-4bfb-ac0a-24ee60ea2b07 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:41.951829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-73c503f6-8ee1-4bfb-ac0a-24ee60ea2b07 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:41.952269 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-73c503f6-8ee1-4bfb-ac0a-24ee60ea2b07 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:41.952941 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-73c503f6-8ee1-4bfb-ac0a-24ee60ea2b07 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:41.953387 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-73c503f6-8ee1-4bfb-ac0a-24ee60ea2b07 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:41.953861 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-73c503f6-8ee1-4bfb-ac0a-24ee60ea2b07 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:42.081458 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-73c503f6-8ee1-4bfb-ac0a-24ee60ea2b07 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:42.089189 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-73c503f6-8ee1-4bfb-ac0a-24ee60ea2b07 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.149061 Aug 17 08:38:42.090163 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 51/111] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:41 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:43.110086 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e71105b1-9c31-4426-9991-66c39b69a16f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:43.110743 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e71105b1-9c31-4426-9991-66c39b69a16f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:43.117121 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e71105b1-9c31-4426-9991-66c39b69a16f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:43.117597 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e71105b1-9c31-4426-9991-66c39b69a16f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:43.118025 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e71105b1-9c31-4426-9991-66c39b69a16f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:43.118769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e71105b1-9c31-4426-9991-66c39b69a16f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:43.119220 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e71105b1-9c31-4426-9991-66c39b69a16f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:43.119667 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e71105b1-9c31-4426-9991-66c39b69a16f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:43.254362 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e71105b1-9c31-4426-9991-66c39b69a16f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:43.261786 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e71105b1-9c31-4426-9991-66c39b69a16f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.155516 Aug 17 08:38:43.262351 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 61/112] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:43 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:44.282558 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d4ae3e22-069f-485e-b89c-9d2e8308ad80 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:44.283197 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d4ae3e22-069f-485e-b89c-9d2e8308ad80 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:44.291479 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4ae3e22-069f-485e-b89c-9d2e8308ad80 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:44.291864 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4ae3e22-069f-485e-b89c-9d2e8308ad80 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:44.292296 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4ae3e22-069f-485e-b89c-9d2e8308ad80 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:44.293080 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4ae3e22-069f-485e-b89c-9d2e8308ad80 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:44.293558 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4ae3e22-069f-485e-b89c-9d2e8308ad80 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:44.294385 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4ae3e22-069f-485e-b89c-9d2e8308ad80 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:44.521595 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-d4ae3e22-069f-485e-b89c-9d2e8308ad80 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:44.529353 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d4ae3e22-069f-485e-b89c-9d2e8308ad80 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.250998 Aug 17 08:38:44.530102 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 52/113] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:44 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:45.552827 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-96fdd085-19ae-4723-8d75-e0ab47977e67 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:45.555830 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-96fdd085-19ae-4723-8d75-e0ab47977e67 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:45.567841 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-96fdd085-19ae-4723-8d75-e0ab47977e67 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:45.586416 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-96fdd085-19ae-4723-8d75-e0ab47977e67 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:45.588001 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-96fdd085-19ae-4723-8d75-e0ab47977e67 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:45.589788 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-96fdd085-19ae-4723-8d75-e0ab47977e67 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:45.598664 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-96fdd085-19ae-4723-8d75-e0ab47977e67 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:45.600304 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-96fdd085-19ae-4723-8d75-e0ab47977e67 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:45.978099 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-96fdd085-19ae-4723-8d75-e0ab47977e67 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:45.985806 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-96fdd085-19ae-4723-8d75-e0ab47977e67 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.438873 Aug 17 08:38:45.986377 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 62/114] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:45 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:47.010336 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-434623b3-5e11-4bc9-8113-c495b6134b09 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:47.011010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-434623b3-5e11-4bc9-8113-c495b6134b09 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:47.019291 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-434623b3-5e11-4bc9-8113-c495b6134b09 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:47.019883 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-434623b3-5e11-4bc9-8113-c495b6134b09 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:47.020610 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-434623b3-5e11-4bc9-8113-c495b6134b09 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:47.021525 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-434623b3-5e11-4bc9-8113-c495b6134b09 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:47.021991 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-434623b3-5e11-4bc9-8113-c495b6134b09 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:47.022384 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-434623b3-5e11-4bc9-8113-c495b6134b09 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:47.206171 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-434623b3-5e11-4bc9-8113-c495b6134b09 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:47.214266 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-434623b3-5e11-4bc9-8113-c495b6134b09 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.207926 Aug 17 08:38:47.215109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 53/115] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:47 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:38:48.235400 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-cf4b16ad-88c3-43b7-b343-8e066c19fe4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:48.236038 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-cf4b16ad-88c3-43b7-b343-8e066c19fe4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:48.243513 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cf4b16ad-88c3-43b7-b343-8e066c19fe4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:48.244020 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cf4b16ad-88c3-43b7-b343-8e066c19fe4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:48.244494 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cf4b16ad-88c3-43b7-b343-8e066c19fe4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:48.245139 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cf4b16ad-88c3-43b7-b343-8e066c19fe4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:48.245588 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cf4b16ad-88c3-43b7-b343-8e066c19fe4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:48.246008 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cf4b16ad-88c3-43b7-b343-8e066c19fe4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:48.373048 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-cf4b16ad-88c3-43b7-b343-8e066c19fe4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:48.381126 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-cf4b16ad-88c3-43b7-b343-8e066c19fe4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.149542 Aug 17 08:38:48.381690 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 63/116] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:48 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:49.401495 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c8f81bc6-7a07-4633-ba62-f0254941f539 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:49.402087 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c8f81bc6-7a07-4633-ba62-f0254941f539 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:49.407925 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c8f81bc6-7a07-4633-ba62-f0254941f539 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:49.408403 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c8f81bc6-7a07-4633-ba62-f0254941f539 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:49.408861 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c8f81bc6-7a07-4633-ba62-f0254941f539 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:49.409531 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c8f81bc6-7a07-4633-ba62-f0254941f539 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:49.409976 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c8f81bc6-7a07-4633-ba62-f0254941f539 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:49.410391 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c8f81bc6-7a07-4633-ba62-f0254941f539 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:49.536470 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c8f81bc6-7a07-4633-ba62-f0254941f539 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:49.543756 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c8f81bc6-7a07-4633-ba62-f0254941f539 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.146085 Aug 17 08:38:49.544351 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 54/117] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:49 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:50.565425 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a3fd6469-b003-481d-a53a-7e595292af5f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:50.565953 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a3fd6469-b003-481d-a53a-7e595292af5f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:50.572208 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a3fd6469-b003-481d-a53a-7e595292af5f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:50.572682 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a3fd6469-b003-481d-a53a-7e595292af5f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:50.573107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a3fd6469-b003-481d-a53a-7e595292af5f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:50.573782 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a3fd6469-b003-481d-a53a-7e595292af5f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:50.574226 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a3fd6469-b003-481d-a53a-7e595292af5f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:50.574644 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a3fd6469-b003-481d-a53a-7e595292af5f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:50.706413 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a3fd6469-b003-481d-a53a-7e595292af5f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:50.714076 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a3fd6469-b003-481d-a53a-7e595292af5f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.153153 Aug 17 08:38:50.714625 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 64/118] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:50 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:51.734229 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9649da0e-12ed-4f7d-9618-053a21e819f4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:51.734832 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9649da0e-12ed-4f7d-9618-053a21e819f4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:51.739738 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=47 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:51.741457 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9649da0e-12ed-4f7d-9618-053a21e819f4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:51.741923 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9649da0e-12ed-4f7d-9618-053a21e819f4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:51.742540 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9649da0e-12ed-4f7d-9618-053a21e819f4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:51.743222 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9649da0e-12ed-4f7d-9618-053a21e819f4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:51.743685 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9649da0e-12ed-4f7d-9618-053a21e819f4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:51.744256 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9649da0e-12ed-4f7d-9618-053a21e819f4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:51.903527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-9649da0e-12ed-4f7d-9618-053a21e819f4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:51.914279 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9649da0e-12ed-4f7d-9618-053a21e819f4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.183647 Aug 17 08:38:51.915640 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 55/119] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:51 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:52.944686 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-eb1b080b-c463-4d7d-8b59-a07f0614c464 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:52.945285 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-eb1b080b-c463-4d7d-8b59-a07f0614c464 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:52.951932 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-eb1b080b-c463-4d7d-8b59-a07f0614c464 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:52.952613 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-eb1b080b-c463-4d7d-8b59-a07f0614c464 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:52.953048 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-eb1b080b-c463-4d7d-8b59-a07f0614c464 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:52.953733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-eb1b080b-c463-4d7d-8b59-a07f0614c464 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:52.954184 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-eb1b080b-c463-4d7d-8b59-a07f0614c464 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:52.954602 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-eb1b080b-c463-4d7d-8b59-a07f0614c464 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:52.984978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-bab0b384-2734-466e-9b06-7ff6af36b575 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:52.985926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-bab0b384-2734-466e-9b06-7ff6af36b575 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:52.993632 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bab0b384-2734-466e-9b06-7ff6af36b575 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:52.994107 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bab0b384-2734-466e-9b06-7ff6af36b575 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:52.994528 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bab0b384-2734-466e-9b06-7ff6af36b575 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:52.995205 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bab0b384-2734-466e-9b06-7ff6af36b575 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:52.995679 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bab0b384-2734-466e-9b06-7ff6af36b575 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:52.996093 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bab0b384-2734-466e-9b06-7ff6af36b575 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:53.022959 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-bab0b384-2734-466e-9b06-7ff6af36b575 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 08:38:53.116291 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-bab0b384-2734-466e-9b06-7ff6af36b575 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "DELETE /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 204 len: 0 microversion: 2.1 time: 0.135400 Aug 17 08:38:53.117218 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 56/120] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:38:52 2022] DELETE /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 17 08:38:53.126624 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-eb1b080b-c463-4d7d-8b59-a07f0614c464 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:53.127774 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9bb94669-e85f-4f20-8c80-8552da612865 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:53.128516 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9bb94669-e85f-4f20-8c80-8552da612865 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:53.130728 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:53.135617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-eb1b080b-c463-4d7d-8b59-a07f0614c464 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.194678 Aug 17 08:38:53.136283 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9bb94669-e85f-4f20-8c80-8552da612865 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:53.136701 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 65/121] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:52 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:53.137078 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9bb94669-e85f-4f20-8c80-8552da612865 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:53.137834 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9bb94669-e85f-4f20-8c80-8552da612865 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:53.138711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9bb94669-e85f-4f20-8c80-8552da612865 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:53.139159 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9bb94669-e85f-4f20-8c80-8552da612865 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:53.139602 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9bb94669-e85f-4f20-8c80-8552da612865 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:53.291332 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-9bb94669-e85f-4f20-8c80-8552da612865 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:53.301201 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9bb94669-e85f-4f20-8c80-8552da612865 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1552 microversion: 2.1 time: 0.178422 Aug 17 08:38:53.315142 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 57/122] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:53 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1552 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:54.158077 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3d9c9c9c-7a47-49a2-bae1-e7fc0aa04f92 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:54.159594 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3d9c9c9c-7a47-49a2-bae1-e7fc0aa04f92 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:54.166997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d9c9c9c-7a47-49a2-bae1-e7fc0aa04f92 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:54.167569 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d9c9c9c-7a47-49a2-bae1-e7fc0aa04f92 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:54.168130 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d9c9c9c-7a47-49a2-bae1-e7fc0aa04f92 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:54.169121 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d9c9c9c-7a47-49a2-bae1-e7fc0aa04f92 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:54.169578 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d9c9c9c-7a47-49a2-bae1-e7fc0aa04f92 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:54.170019 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d9c9c9c-7a47-49a2-bae1-e7fc0aa04f92 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:54.307173 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3d9c9c9c-7a47-49a2-bae1-e7fc0aa04f92 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:54.314552 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3d9c9c9c-7a47-49a2-bae1-e7fc0aa04f92 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.161358 Aug 17 08:38:54.315123 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 66/123] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:54 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:54.333439 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-10fda357-c1a2-49b1-9449-94bb0686d2e4 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:54.334033 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-10fda357-c1a2-49b1-9449-94bb0686d2e4 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:54.339928 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-10fda357-c1a2-49b1-9449-94bb0686d2e4 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:54.340405 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-10fda357-c1a2-49b1-9449-94bb0686d2e4 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:54.340829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-10fda357-c1a2-49b1-9449-94bb0686d2e4 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:54.341495 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-10fda357-c1a2-49b1-9449-94bb0686d2e4 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:54.341938 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-10fda357-c1a2-49b1-9449-94bb0686d2e4 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:54.342365 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-10fda357-c1a2-49b1-9449-94bb0686d2e4 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:54.476581 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-10fda357-c1a2-49b1-9449-94bb0686d2e4 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:54.480215 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:54.485862 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-10fda357-c1a2-49b1-9449-94bb0686d2e4 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1552 microversion: 2.1 time: 0.157016 Aug 17 08:38:54.487157 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 58/124] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:54 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:55.350482 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-14ef0ae3-8152-4791-9ae6-fd0ffafe2528 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:55.355434 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-14ef0ae3-8152-4791-9ae6-fd0ffafe2528 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:55.369133 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=46 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:38:55.374673 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14ef0ae3-8152-4791-9ae6-fd0ffafe2528 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:55.375329 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14ef0ae3-8152-4791-9ae6-fd0ffafe2528 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:55.375801 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14ef0ae3-8152-4791-9ae6-fd0ffafe2528 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:55.377880 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14ef0ae3-8152-4791-9ae6-fd0ffafe2528 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:55.381230 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14ef0ae3-8152-4791-9ae6-fd0ffafe2528 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:55.392236 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14ef0ae3-8152-4791-9ae6-fd0ffafe2528 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:55.508445 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5e8ff172-633a-4698-b3ef-36e5a315e883 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:55.509572 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5e8ff172-633a-4698-b3ef-36e5a315e883 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:55.516721 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5e8ff172-633a-4698-b3ef-36e5a315e883 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:55.517441 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5e8ff172-633a-4698-b3ef-36e5a315e883 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:55.518660 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5e8ff172-633a-4698-b3ef-36e5a315e883 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:55.519581 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5e8ff172-633a-4698-b3ef-36e5a315e883 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:55.520240 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5e8ff172-633a-4698-b3ef-36e5a315e883 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:55.520888 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5e8ff172-633a-4698-b3ef-36e5a315e883 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:55.574690 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-14ef0ae3-8152-4791-9ae6-fd0ffafe2528 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:55.589453 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-14ef0ae3-8152-4791-9ae6-fd0ffafe2528 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.255824 Aug 17 08:38:55.590055 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 67/125] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:55 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:55.862189 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5e8ff172-633a-4698-b3ef-36e5a315e883 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:55.871181 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5e8ff172-633a-4698-b3ef-36e5a315e883 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1552 microversion: 2.1 time: 0.368040 Aug 17 08:38:55.871926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 59/126] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:55 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1552 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:56.620757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3ca40a3a-c5f8-4d4e-9e3b-cce90bca195c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:56.622907 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3ca40a3a-c5f8-4d4e-9e3b-cce90bca195c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:56.639716 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-1b993fc4-14e9-47c5-b2d5-b43f8ed9cffd req-46ec6e8e-216c-4f55-8949-810b2db68645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acc7affb-d8db-4d51-a10a-95235ce04aa3", "name": "network-vif-deleted", "tag": "9df79908-9527-4436-9dcf-41c6d5696780"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:38:56.645090 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3ca40a3a-c5f8-4d4e-9e3b-cce90bca195c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:56.647149 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3ca40a3a-c5f8-4d4e-9e3b-cce90bca195c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:56.649641 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3ca40a3a-c5f8-4d4e-9e3b-cce90bca195c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:56.650705 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3ca40a3a-c5f8-4d4e-9e3b-cce90bca195c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:56.653529 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3ca40a3a-c5f8-4d4e-9e3b-cce90bca195c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:56.655575 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3ca40a3a-c5f8-4d4e-9e3b-cce90bca195c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:56.661606 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-1b993fc4-14e9-47c5-b2d5-b43f8ed9cffd req-46ec6e8e-216c-4f55-8949-810b2db68645 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:56.667412 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-1b993fc4-14e9-47c5-b2d5-b43f8ed9cffd req-46ec6e8e-216c-4f55-8949-810b2db68645 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:56.669883 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-1b993fc4-14e9-47c5-b2d5-b43f8ed9cffd req-46ec6e8e-216c-4f55-8949-810b2db68645 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:56.712138 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-1b993fc4-14e9-47c5-b2d5-b43f8ed9cffd req-46ec6e8e-216c-4f55-8949-810b2db68645 service nova] Creating event network-vif-deleted:9df79908-9527-4436-9dcf-41c6d5696780 for instance acc7affb-d8db-4d51-a10a-95235ce04aa3 on hv-cinder-85331 Aug 17 08:38:56.719917 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-1b993fc4-14e9-47c5-b2d5-b43f8ed9cffd req-46ec6e8e-216c-4f55-8949-810b2db68645 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084423 Aug 17 08:38:56.725075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 60/127] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:38:56.895152 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-068d5f51-5a50-49a2-bdfa-3edf69d968e1 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:56.896065 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-068d5f51-5a50-49a2-bdfa-3edf69d968e1 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:56.906194 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-068d5f51-5a50-49a2-bdfa-3edf69d968e1 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:56.906943 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-068d5f51-5a50-49a2-bdfa-3edf69d968e1 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:56.907925 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-068d5f51-5a50-49a2-bdfa-3edf69d968e1 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:56.909574 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-068d5f51-5a50-49a2-bdfa-3edf69d968e1 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:56.910354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-068d5f51-5a50-49a2-bdfa-3edf69d968e1 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:56.910986 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-068d5f51-5a50-49a2-bdfa-3edf69d968e1 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:57.016273 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3ca40a3a-c5f8-4d4e-9e3b-cce90bca195c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:57.033844 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3ca40a3a-c5f8-4d4e-9e3b-cce90bca195c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.423514 Aug 17 08:38:57.034526 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 68/128] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:56 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:57.041373 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-068d5f51-5a50-49a2-bdfa-3edf69d968e1 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:57.054414 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-068d5f51-5a50-49a2-bdfa-3edf69d968e1 tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1345 microversion: 2.1 time: 0.164775 Aug 17 08:38:57.055017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 61/129] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:56 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1345 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:58.057561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-01bd5dda-e043-4870-af98-548c3117a695 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:58.058382 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-01bd5dda-e043-4870-af98-548c3117a695 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:58.065182 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-01bd5dda-e043-4870-af98-548c3117a695 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:58.065669 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-01bd5dda-e043-4870-af98-548c3117a695 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:58.066104 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-01bd5dda-e043-4870-af98-548c3117a695 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:58.066851 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-01bd5dda-e043-4870-af98-548c3117a695 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:58.067299 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-01bd5dda-e043-4870-af98-548c3117a695 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:58.067754 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-01bd5dda-e043-4870-af98-548c3117a695 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:58.082050 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8d2b4a30-546f-473d-ac91-98bede02041e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:58.082918 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8d2b4a30-546f-473d-ac91-98bede02041e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:58.090722 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d2b4a30-546f-473d-ac91-98bede02041e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:58.097224 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d2b4a30-546f-473d-ac91-98bede02041e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:58.097737 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d2b4a30-546f-473d-ac91-98bede02041e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:58.098524 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d2b4a30-546f-473d-ac91-98bede02041e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:58.098991 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d2b4a30-546f-473d-ac91-98bede02041e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:58.099411 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d2b4a30-546f-473d-ac91-98bede02041e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:58.138505 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d2b4a30-546f-473d-ac91-98bede02041e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:58.138994 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d2b4a30-546f-473d-ac91-98bede02041e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:58.139425 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d2b4a30-546f-473d-ac91-98bede02041e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:58.141119 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-8d2b4a30-546f-473d-ac91-98bede02041e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lazy-loading 'fault' on Instance uuid acc7affb-d8db-4d51-a10a-95235ce04aa3 {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:38:58.201340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8d2b4a30-546f-473d-ac91-98bede02041e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def7315f294e99ba206f5db1ef282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db908214d6fb40909a4728b207bf776a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:58.211458 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8d2b4a30-546f-473d-ac91-98bede02041e tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 200 len: 1350 microversion: 2.1 time: 0.134359 Aug 17 08:38:58.212821 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 62/130] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:58 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:58.290215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-01bd5dda-e043-4870-af98-548c3117a695 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:58.298947 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-01bd5dda-e043-4870-af98-548c3117a695 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.246808 Aug 17 08:38:58.300107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 69/131] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:58 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:38:59.234486 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b08b5303-ecf9-4e48-8f5a-8a4a0409c1ae tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:59.235906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b08b5303-ecf9-4e48-8f5a-8a4a0409c1ae tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:59.243289 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b08b5303-ecf9-4e48-8f5a-8a4a0409c1ae tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:59.244190 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b08b5303-ecf9-4e48-8f5a-8a4a0409c1ae tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:59.245117 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b08b5303-ecf9-4e48-8f5a-8a4a0409c1ae tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:59.247052 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b08b5303-ecf9-4e48-8f5a-8a4a0409c1ae tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:59.249142 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b08b5303-ecf9-4e48-8f5a-8a4a0409c1ae tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:59.249926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b08b5303-ecf9-4e48-8f5a-8a4a0409c1ae tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:59.276035 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-b08b5303-ecf9-4e48-8f5a-8a4a0409c1ae tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] HTTP exception thrown: Instance acc7affb-d8db-4d51-a10a-95235ce04aa3 could not be found. Aug 17 08:38:59.283217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b08b5303-ecf9-4e48-8f5a-8a4a0409c1ae tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Request method failure captured: Aug 17 08:38:59.283217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 HTTP/1.1 Aug 17 08:38:59.283217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:38:59.283217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:38:59.283217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:38:59.283217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:38:59.283217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:38:59.283217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:38:59.283217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:38:59.283217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:38:59.283217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_Kjin_UWbQSwFVsLTKbsNK-OEvZ3mAwWnvvog3LyqqEqErmS4PHYScSYJvL7GwtZ3Fh79jg0rovwz5RAyr66rII0NHCf_jTJFKfkTVQuI3Sw_FJci6S0NPNdw18o88XsVbpD7hdypiwo1VudW8CfkmTY3Dy2p6B6mtt1evpThw1dC8s Aug 17 08:38:59.283217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:38:59.283217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:38:59.283217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:38:59.283217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:38:59.283217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:38:59.283217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:38:59.283217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: db908214d6fb40909a4728b207bf776a Aug 17 08:38:59.283217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-DeleteServersTestJSON-114686274 Aug 17 08:38:59.283217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:38:59.283217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:38:59.284712 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/db908214d6fb40909a4728b207bf776a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/db908214d6fb40909a4728b207bf776a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/db908214d6fb40909a4728b207bf776a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_db908214d6fb40909a4728b207bf776a", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:38:59.284712 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-DeleteServersTestJSON-114686274 Aug 17 08:38:59.284712 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: db908214d6fb40909a4728b207bf776a Aug 17 08:38:59.284712 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-DeleteServersTestJSON-114686274 Aug 17 08:38:59.284712 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-DeleteServersTestJSON-114686274-project Aug 17 08:38:59.284712 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:38:59.284712 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:38:59.284712 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: 51def7315f294e99ba206f5db1ef282f Aug 17 08:38:59.284712 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-DeleteServersTestJSON-114686274-project Aug 17 08:38:59.284712 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:38:59.284712 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Instance acc7affb-d8db-4d51-a10a-95235ce04aa3 could not be found. Aug 17 08:38:59.284712 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'id': 'acc7affb-d8db-4d51-a10a-95235ce04aa3'} Aug 17 08:38:59.286023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:38:59.286023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:38:59.286023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:38:59.286023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:38:59.286023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:38:59.286023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:38:59.286023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:38:59.286023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:38:59.286023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:38:59.286023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:38:59.286023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acc7affb-d8db-4d51-a10a-95235ce04aa3 could not be found. Aug 17 08:38:59.286023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:38:59.286023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:38:59.286023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:38:59.286023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:38:59.286023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:38:59.286023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:38:59.286023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:38:59.286023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:38:59.286023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:38:59.287300 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:38:59.287300 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:38:59.287300 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:38:59.287300 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:38:59.287300 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:38:59.287300 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:38:59.287300 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:38:59.287300 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acc7affb-d8db-4d51-a10a-95235ce04aa3 could not be found. Aug 17 08:38:59.287300 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:38:59.287300 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:38:59.287300 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:38:59.287300 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:38:59.287300 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:38:59.287300 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:38:59.287300 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:38:59.287300 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:38:59.287300 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acc7affb-d8db-4d51-a10a-95235ce04aa3 could not be found. Aug 17 08:38:59.287300 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:38:59.292371 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b08b5303-ecf9-4e48-8f5a-8a4a0409c1ae tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Returning 404 to user: Instance acc7affb-d8db-4d51-a10a-95235ce04aa3 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:38:59.293517 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b08b5303-ecf9-4e48-8f5a-8a4a0409c1ae tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 404 len: 111 microversion: 2.1 time: 0.064394 Aug 17 08:38:59.294750 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 63/132] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:59 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:38:59.324008 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d7363104-776a-43e4-a625-356ac9532bc5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:59.324474 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d7363104-776a-43e4-a625-356ac9532bc5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:59.349320 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d7363104-776a-43e4-a625-356ac9532bc5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:59.350557 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d7363104-776a-43e4-a625-356ac9532bc5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:59.351162 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d7363104-776a-43e4-a625-356ac9532bc5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:59.352060 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d7363104-776a-43e4-a625-356ac9532bc5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:59.352661 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d7363104-776a-43e4-a625-356ac9532bc5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:59.353236 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d7363104-776a-43e4-a625-356ac9532bc5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:59.543030 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a68b6a32-d7be-4271-837f-d66eeba63f2b tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:38:59.546482 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a68b6a32-d7be-4271-837f-d66eeba63f2b tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:38:59.587837 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a68b6a32-d7be-4271-837f-d66eeba63f2b tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:59.588363 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a68b6a32-d7be-4271-837f-d66eeba63f2b tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:59.588702 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a68b6a32-d7be-4271-837f-d66eeba63f2b tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:59.589400 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a68b6a32-d7be-4271-837f-d66eeba63f2b tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:38:59.589856 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a68b6a32-d7be-4271-837f-d66eeba63f2b tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:38:59.590282 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a68b6a32-d7be-4271-837f-d66eeba63f2b tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:38:59.621485 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-a68b6a32-d7be-4271-837f-d66eeba63f2b tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] HTTP exception thrown: Instance acc7affb-d8db-4d51-a10a-95235ce04aa3 could not be found. Aug 17 08:38:59.628097 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a68b6a32-d7be-4271-837f-d66eeba63f2b tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Request method failure captured: Aug 17 08:38:59.628097 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3/os-volume_attachments HTTP/1.1 Aug 17 08:38:59.628097 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:38:59.628097 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:38:59.628097 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:38:59.628097 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:38:59.628097 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:38:59.628097 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:38:59.628097 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:38:59.628097 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:38:59.628097 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_Kjin_UWbQSwFVsLTKbsNK-OEvZ3mAwWnvvog3LyqqEqErmS4PHYScSYJvL7GwtZ3Fh79jg0rovwz5RAyr66rII0NHCf_jTJFKfkTVQuI3Sw_FJci6S0NPNdw18o88XsVbpD7hdypiwo1VudW8CfkmTY3Dy2p6B6mtt1evpThw1dC8s Aug 17 08:38:59.628097 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:38:59.628097 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:38:59.628097 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:38:59.628097 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:38:59.628097 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:38:59.628097 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:38:59.628097 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: db908214d6fb40909a4728b207bf776a Aug 17 08:38:59.628097 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-DeleteServersTestJSON-114686274 Aug 17 08:38:59.628097 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:38:59.628097 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:38:59.629348 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/db908214d6fb40909a4728b207bf776a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/db908214d6fb40909a4728b207bf776a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/db908214d6fb40909a4728b207bf776a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_db908214d6fb40909a4728b207bf776a", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:38:59.629348 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-DeleteServersTestJSON-114686274 Aug 17 08:38:59.629348 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: db908214d6fb40909a4728b207bf776a Aug 17 08:38:59.629348 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-DeleteServersTestJSON-114686274 Aug 17 08:38:59.629348 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-DeleteServersTestJSON-114686274-project Aug 17 08:38:59.629348 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:38:59.629348 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:38:59.629348 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: 51def7315f294e99ba206f5db1ef282f Aug 17 08:38:59.629348 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-DeleteServersTestJSON-114686274-project Aug 17 08:38:59.629348 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:38:59.629348 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Instance acc7affb-d8db-4d51-a10a-95235ce04aa3 could not be found. Aug 17 08:38:59.629348 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'server_id': 'acc7affb-d8db-4d51-a10a-95235ce04aa3'} Aug 17 08:38:59.630090 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:38:59.630090 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:38:59.630090 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:38:59.630090 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:38:59.630090 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:38:59.630090 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:38:59.630090 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:38:59.630090 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:38:59.630090 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:38:59.630090 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:38:59.630090 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acc7affb-d8db-4d51-a10a-95235ce04aa3 could not be found. Aug 17 08:38:59.630090 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:38:59.630090 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:38:59.630090 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:38:59.630090 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:38:59.630090 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:38:59.630090 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:38:59.630090 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:38:59.630090 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:38:59.630090 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:38:59.631154 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:38:59.631154 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 17 08:38:59.631154 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 08:38:59.631154 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 17 08:38:59.631154 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 08:38:59.631154 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 17 08:38:59.631154 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 17 08:38:59.631154 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:38:59.631154 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:38:59.631154 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acc7affb-d8db-4d51-a10a-95235ce04aa3 could not be found. Aug 17 08:38:59.631154 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:38:59.631154 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:38:59.631154 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:38:59.631154 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:38:59.631154 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:38:59.631154 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:38:59.631154 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:38:59.631154 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:38:59.631154 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acc7affb-d8db-4d51-a10a-95235ce04aa3 could not be found. Aug 17 08:38:59.631154 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:38:59.633733 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a68b6a32-d7be-4271-837f-d66eeba63f2b tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Returning 404 to user: Instance acc7affb-d8db-4d51-a10a-95235ce04aa3 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:38:59.633733 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a68b6a32-d7be-4271-837f-d66eeba63f2b tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.093821 Aug 17 08:38:59.633733 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 64/133] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 08:38:59 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3/os-volume_attachments => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 08:38:59.771169 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d7363104-776a-43e4-a625-356ac9532bc5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:38:59.781844 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d7363104-776a-43e4-a625-356ac9532bc5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.459860 Aug 17 08:38:59.782586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 70/134] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:38:59 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:00.805075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a5aecc15-00ea-4698-a6cd-fc47cf2fe02b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:00.806623 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a5aecc15-00ea-4698-a6cd-fc47cf2fe02b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:00.817237 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a5aecc15-00ea-4698-a6cd-fc47cf2fe02b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:00.818718 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a5aecc15-00ea-4698-a6cd-fc47cf2fe02b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:00.819166 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a5aecc15-00ea-4698-a6cd-fc47cf2fe02b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:00.820038 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a5aecc15-00ea-4698-a6cd-fc47cf2fe02b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:00.820514 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a5aecc15-00ea-4698-a6cd-fc47cf2fe02b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:00.822127 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a5aecc15-00ea-4698-a6cd-fc47cf2fe02b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:00.966954 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-32b75e93-3f91-4dca-8617-b8770d072c8a tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:00.968434 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-32b75e93-3f91-4dca-8617-b8770d072c8a tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:00.979238 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-32b75e93-3f91-4dca-8617-b8770d072c8a tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:00.979986 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-32b75e93-3f91-4dca-8617-b8770d072c8a tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:00.980558 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-32b75e93-3f91-4dca-8617-b8770d072c8a tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:00.982624 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-32b75e93-3f91-4dca-8617-b8770d072c8a tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:00.984110 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-32b75e93-3f91-4dca-8617-b8770d072c8a tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:00.986723 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-32b75e93-3f91-4dca-8617-b8770d072c8a tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:01.008852 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-32b75e93-3f91-4dca-8617-b8770d072c8a tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] HTTP exception thrown: Instance acc7affb-d8db-4d51-a10a-95235ce04aa3 could not be found. Aug 17 08:39:01.013533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-32b75e93-3f91-4dca-8617-b8770d072c8a tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Request method failure captured: Aug 17 08:39:01.013533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: DELETE /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 HTTP/1.1 Aug 17 08:39:01.013533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:39:01.013533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:39:01.013533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:39:01.013533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:39:01.013533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:39:01.013533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:39:01.013533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:39:01.013533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:39:01.013533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_Kjin_UWbQSwFVsLTKbsNK-OEvZ3mAwWnvvog3LyqqEqErmS4PHYScSYJvL7GwtZ3Fh79jg0rovwz5RAyr66rII0NHCf_jTJFKfkTVQuI3Sw_FJci6S0NPNdw18o88XsVbpD7hdypiwo1VudW8CfkmTY3Dy2p6B6mtt1evpThw1dC8s Aug 17 08:39:01.013533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:39:01.013533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:39:01.013533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:39:01.013533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:39:01.013533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:39:01.013533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:39:01.013533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: db908214d6fb40909a4728b207bf776a Aug 17 08:39:01.013533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-DeleteServersTestJSON-114686274 Aug 17 08:39:01.013533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:39:01.013533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:39:01.014977 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/db908214d6fb40909a4728b207bf776a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/db908214d6fb40909a4728b207bf776a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/db908214d6fb40909a4728b207bf776a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_db908214d6fb40909a4728b207bf776a", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:39:01.014977 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-DeleteServersTestJSON-114686274 Aug 17 08:39:01.014977 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: db908214d6fb40909a4728b207bf776a Aug 17 08:39:01.014977 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-DeleteServersTestJSON-114686274 Aug 17 08:39:01.014977 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-DeleteServersTestJSON-114686274-project Aug 17 08:39:01.014977 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:39:01.014977 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:39:01.014977 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: 51def7315f294e99ba206f5db1ef282f Aug 17 08:39:01.014977 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-DeleteServersTestJSON-114686274-project Aug 17 08:39:01.014977 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: > Aug 17 08:39:01.014977 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Instance acc7affb-d8db-4d51-a10a-95235ce04aa3 could not be found. Aug 17 08:39:01.014977 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': 'acc7affb-d8db-4d51-a10a-95235ce04aa3'} Aug 17 08:39:01.015769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:39:01.015769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:39:01.015769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:39:01.015769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:39:01.015769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:39:01.015769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:39:01.015769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:39:01.015769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:39:01.015769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:39:01.015769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:39:01.015769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acc7affb-d8db-4d51-a10a-95235ce04aa3 could not be found. Aug 17 08:39:01.015769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:01.015769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:39:01.015769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:01.015769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:39:01.015769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:39:01.015769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:39:01.015769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:39:01.015769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:39:01.015769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:39:01.017051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:39:01.017051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 08:39:01.017051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 08:39:01.017051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 08:39:01.017051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 08:39:01.017051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:39:01.017051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:39:01.017051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:39:01.017051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:39:01.017051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acc7affb-d8db-4d51-a10a-95235ce04aa3 could not be found. Aug 17 08:39:01.017051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:01.017051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:39:01.017051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:01.017051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:39:01.017051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:39:01.017051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:39:01.017051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:39:01.017051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:39:01.017051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acc7affb-d8db-4d51-a10a-95235ce04aa3 could not be found. Aug 17 08:39:01.017051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:01.019369 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-32b75e93-3f91-4dca-8617-b8770d072c8a tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Returning 404 to user: Instance acc7affb-d8db-4d51-a10a-95235ce04aa3 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:39:01.020525 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-32b75e93-3f91-4dca-8617-b8770d072c8a tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "DELETE /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 404 len: 111 microversion: 2.1 time: 0.058139 Aug 17 08:39:01.021234 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 71/135] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:39:00 2022] DELETE /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:39:01.024550 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a5aecc15-00ea-4698-a6cd-fc47cf2fe02b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:01.030205 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5c55dd62-6c8d-4fbb-8098-7801f76c936c tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:01.030811 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-5c55dd62-6c8d-4fbb-8098-7801f76c936c tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] [instance: acc7affb-d8db-4d51-a10a-95235ce04aa3] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:01.030934 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a5aecc15-00ea-4698-a6cd-fc47cf2fe02b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.230249 Aug 17 08:39:01.043684 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 65/136] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:00 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:01.044172 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5c55dd62-6c8d-4fbb-8098-7801f76c936c tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:01.044172 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5c55dd62-6c8d-4fbb-8098-7801f76c936c tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:01.044172 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5c55dd62-6c8d-4fbb-8098-7801f76c936c tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:01.044172 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5c55dd62-6c8d-4fbb-8098-7801f76c936c tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:01.044611 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5c55dd62-6c8d-4fbb-8098-7801f76c936c tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:01.044611 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5c55dd62-6c8d-4fbb-8098-7801f76c936c tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:01.058444 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-5c55dd62-6c8d-4fbb-8098-7801f76c936c tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] HTTP exception thrown: Instance acc7affb-d8db-4d51-a10a-95235ce04aa3 could not be found. Aug 17 08:39:01.060197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5c55dd62-6c8d-4fbb-8098-7801f76c936c tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Request method failure captured: Aug 17 08:39:01.060197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 HTTP/1.1 Aug 17 08:39:01.060197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:39:01.060197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:39:01.060197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:39:01.060197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:39:01.060197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:39:01.060197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:39:01.060197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:39:01.060197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:39:01.060197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_Kjin_UWbQSwFVsLTKbsNK-OEvZ3mAwWnvvog3LyqqEqErmS4PHYScSYJvL7GwtZ3Fh79jg0rovwz5RAyr66rII0NHCf_jTJFKfkTVQuI3Sw_FJci6S0NPNdw18o88XsVbpD7hdypiwo1VudW8CfkmTY3Dy2p6B6mtt1evpThw1dC8s Aug 17 08:39:01.060197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:39:01.060197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:39:01.060197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:39:01.060197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:39:01.060197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:39:01.060197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:39:01.060197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: db908214d6fb40909a4728b207bf776a Aug 17 08:39:01.060197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-DeleteServersTestJSON-114686274 Aug 17 08:39:01.060197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:39:01.060197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:39:01.061451 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/db908214d6fb40909a4728b207bf776a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/db908214d6fb40909a4728b207bf776a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/db908214d6fb40909a4728b207bf776a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_db908214d6fb40909a4728b207bf776a", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:39:01.061451 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-DeleteServersTestJSON-114686274 Aug 17 08:39:01.061451 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: db908214d6fb40909a4728b207bf776a Aug 17 08:39:01.061451 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-DeleteServersTestJSON-114686274 Aug 17 08:39:01.061451 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-DeleteServersTestJSON-114686274-project Aug 17 08:39:01.061451 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:39:01.061451 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:39:01.061451 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: 51def7315f294e99ba206f5db1ef282f Aug 17 08:39:01.061451 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-DeleteServersTestJSON-114686274-project Aug 17 08:39:01.061451 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: > Aug 17 08:39:01.061451 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Instance acc7affb-d8db-4d51-a10a-95235ce04aa3 could not be found. Aug 17 08:39:01.061451 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': 'acc7affb-d8db-4d51-a10a-95235ce04aa3'} Aug 17 08:39:01.062136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:39:01.062136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:39:01.062136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:39:01.062136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:39:01.062136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:39:01.062136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:39:01.062136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:39:01.062136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:39:01.062136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:39:01.062136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:39:01.062136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acc7affb-d8db-4d51-a10a-95235ce04aa3 could not be found. Aug 17 08:39:01.062136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:01.062136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:39:01.062136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:01.062136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:39:01.062136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:39:01.062136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:39:01.062136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:39:01.062136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:39:01.062136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:39:01.063532 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:39:01.063532 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:39:01.063532 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:39:01.063532 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:39:01.063532 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:39:01.063532 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:39:01.063532 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:39:01.063532 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acc7affb-d8db-4d51-a10a-95235ce04aa3 could not be found. Aug 17 08:39:01.063532 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:01.063532 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:39:01.063532 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:01.063532 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:39:01.063532 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:39:01.063532 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:39:01.063532 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:39:01.063532 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:39:01.063532 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acc7affb-d8db-4d51-a10a-95235ce04aa3 could not be found. Aug 17 08:39:01.063532 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:01.064810 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5c55dd62-6c8d-4fbb-8098-7801f76c936c tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] Returning 404 to user: Instance acc7affb-d8db-4d51-a10a-95235ce04aa3 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:39:01.064810 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-5c55dd62-6c8d-4fbb-8098-7801f76c936c tempest-DeleteServersTestJSON-114686274 tempest-DeleteServersTestJSON-114686274-project] 10.222.0.15 "GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3" status: 404 len: 111 microversion: 2.1 time: 0.036024 Aug 17 08:39:01.065908 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 72/137] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:01 2022] GET /compute/v2.1/servers/acc7affb-d8db-4d51-a10a-95235ce04aa3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:39:02.051948 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b861dd50-dac2-44b2-9ef2-d846d1a27da2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:02.052541 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b861dd50-dac2-44b2-9ef2-d846d1a27da2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:02.058638 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b861dd50-dac2-44b2-9ef2-d846d1a27da2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:02.059112 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b861dd50-dac2-44b2-9ef2-d846d1a27da2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:02.059554 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b861dd50-dac2-44b2-9ef2-d846d1a27da2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:02.060316 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b861dd50-dac2-44b2-9ef2-d846d1a27da2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:02.060768 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b861dd50-dac2-44b2-9ef2-d846d1a27da2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:02.061215 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b861dd50-dac2-44b2-9ef2-d846d1a27da2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:02.290947 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b861dd50-dac2-44b2-9ef2-d846d1a27da2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:02.298741 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b861dd50-dac2-44b2-9ef2-d846d1a27da2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.250401 Aug 17 08:39:02.299317 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 66/138] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:02 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:03.320058 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-53594103-7250-4a14-b793-b705688514e6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:03.320662 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-53594103-7250-4a14-b793-b705688514e6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:03.327394 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-53594103-7250-4a14-b793-b705688514e6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:03.328040 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-53594103-7250-4a14-b793-b705688514e6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:03.328576 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-53594103-7250-4a14-b793-b705688514e6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:03.329341 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-53594103-7250-4a14-b793-b705688514e6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:03.330420 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-53594103-7250-4a14-b793-b705688514e6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:03.330907 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-53594103-7250-4a14-b793-b705688514e6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:03.522793 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-53594103-7250-4a14-b793-b705688514e6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:03.533304 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-53594103-7250-4a14-b793-b705688514e6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.216907 Aug 17 08:39:03.534472 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 73/139] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:03 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:04.555105 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-77448cc4-59fa-4072-9472-6957550cbc37 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:04.564803 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-77448cc4-59fa-4072-9472-6957550cbc37 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:04.576296 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-77448cc4-59fa-4072-9472-6957550cbc37 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:04.577097 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-77448cc4-59fa-4072-9472-6957550cbc37 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:04.577949 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-77448cc4-59fa-4072-9472-6957550cbc37 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:04.578880 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-77448cc4-59fa-4072-9472-6957550cbc37 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:04.579515 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-77448cc4-59fa-4072-9472-6957550cbc37 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:04.580821 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-77448cc4-59fa-4072-9472-6957550cbc37 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:05.113234 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-77448cc4-59fa-4072-9472-6957550cbc37 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:05.121980 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-77448cc4-59fa-4072-9472-6957550cbc37 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.571657 Aug 17 08:39:05.122806 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 67/140] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:04 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:06.145164 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b4640a04-c439-45b2-8a54-c3d952f27ab4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:06.146166 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b4640a04-c439-45b2-8a54-c3d952f27ab4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:06.153540 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b4640a04-c439-45b2-8a54-c3d952f27ab4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:06.154055 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b4640a04-c439-45b2-8a54-c3d952f27ab4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:06.154484 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b4640a04-c439-45b2-8a54-c3d952f27ab4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:06.155347 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b4640a04-c439-45b2-8a54-c3d952f27ab4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:06.156169 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b4640a04-c439-45b2-8a54-c3d952f27ab4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:06.156599 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b4640a04-c439-45b2-8a54-c3d952f27ab4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:06.315014 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b4640a04-c439-45b2-8a54-c3d952f27ab4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:06.323412 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b4640a04-c439-45b2-8a54-c3d952f27ab4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.184111 Aug 17 08:39:06.324170 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 74/141] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:06 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:06.566063 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-41c6ceb0-ada3-406d-9efe-05707f5bca6d tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Action: 'create', calling method: .version_select at 0x7f3f85631a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1520704409"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:39:06.884246 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-41c6ceb0-ada3-406d-9efe-05707f5bca6d tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.445184 Aug 17 08:39:06.891499 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 68/142] 10.222.0.15 () {60 vars in 1155 bytes} [Wed Aug 17 08:39:06 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 447 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 17 08:39:06.898436 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0ed24687-e525-4bf0-9967-7c3e8f6dddfe tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Calling method '.version_select at 0x7f3f85e42700>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:06.948883 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0ed24687-e525-4bf0-9967-7c3e8f6dddfe tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746" status: 200 len: 345 microversion: 2.1 time: 0.054235 Aug 17 08:39:06.949437 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 75/143] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 08:39:06 2022] GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:39:07.346558 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5232f944-5fdf-4c15-b462-f9caf03ec946 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:07.347146 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5232f944-5fdf-4c15-b462-f9caf03ec946 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:07.353007 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5232f944-5fdf-4c15-b462-f9caf03ec946 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:07.353480 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5232f944-5fdf-4c15-b462-f9caf03ec946 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:07.353907 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5232f944-5fdf-4c15-b462-f9caf03ec946 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:07.354567 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5232f944-5fdf-4c15-b462-f9caf03ec946 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:07.355006 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5232f944-5fdf-4c15-b462-f9caf03ec946 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:07.355413 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5232f944-5fdf-4c15-b462-f9caf03ec946 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:07.481158 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5232f944-5fdf-4c15-b462-f9caf03ec946 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:07.489545 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5232f944-5fdf-4c15-b462-f9caf03ec946 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.147439 Aug 17 08:39:07.490101 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 69/144] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:07 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:07.962628 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0020c91a-0f69-4909-805b-e894ee0edef0 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Calling method '.version_select at 0x7f3f85e3a670>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:08.008798 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0020c91a-0f69-4909-805b-e894ee0edef0 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746" status: 200 len: 345 microversion: 2.1 time: 0.050437 Aug 17 08:39:08.011039 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 76/145] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 08:39:07 2022] GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:39:08.509900 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d82d70ab-1893-4887-bbed-1123653926d9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:08.510500 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d82d70ab-1893-4887-bbed-1123653926d9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:08.516450 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d82d70ab-1893-4887-bbed-1123653926d9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:08.516931 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d82d70ab-1893-4887-bbed-1123653926d9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:08.517919 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d82d70ab-1893-4887-bbed-1123653926d9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:08.518587 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d82d70ab-1893-4887-bbed-1123653926d9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:08.519038 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d82d70ab-1893-4887-bbed-1123653926d9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:08.519456 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d82d70ab-1893-4887-bbed-1123653926d9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:08.654563 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-d82d70ab-1893-4887-bbed-1123653926d9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:08.661946 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d82d70ab-1893-4887-bbed-1123653926d9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.155910 Aug 17 08:39:08.662514 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 70/146] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:08 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:39:09.022455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-78276dfb-d71e-4a95-9130-194502953218 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Calling method '.version_select at 0x7f3f85e495e0>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:09.073484 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-78276dfb-d71e-4a95-9130-194502953218 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746" status: 200 len: 345 microversion: 2.1 time: 0.055161 Aug 17 08:39:09.074051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 77/147] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 08:39:09 2022] GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:39:09.682493 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5e7aaa70-0233-428b-bfd3-5c7c6714f7c5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:09.683110 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5e7aaa70-0233-428b-bfd3-5c7c6714f7c5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:09.690159 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5e7aaa70-0233-428b-bfd3-5c7c6714f7c5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:09.690647 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5e7aaa70-0233-428b-bfd3-5c7c6714f7c5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:09.691073 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5e7aaa70-0233-428b-bfd3-5c7c6714f7c5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:09.691792 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5e7aaa70-0233-428b-bfd3-5c7c6714f7c5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:09.692239 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5e7aaa70-0233-428b-bfd3-5c7c6714f7c5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:09.692662 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5e7aaa70-0233-428b-bfd3-5c7c6714f7c5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:09.825063 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5e7aaa70-0233-428b-bfd3-5c7c6714f7c5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:09.833640 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5e7aaa70-0233-428b-bfd3-5c7c6714f7c5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.154892 Aug 17 08:39:09.834210 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 71/148] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:09 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:10.088660 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-aa970d57-8262-44fe-af37-f698a0ef3d44 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Calling method '.version_select at 0x7f3f85fdac10>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:10.140132 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-aa970d57-8262-44fe-af37-f698a0ef3d44 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746" status: 200 len: 345 microversion: 2.1 time: 0.056983 Aug 17 08:39:10.140700 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 78/149] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 08:39:10 2022] GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:39:10.854447 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f37718e6-dffc-4fff-907d-fe1ad6b17a90 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:10.854995 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f37718e6-dffc-4fff-907d-fe1ad6b17a90 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:10.860884 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f37718e6-dffc-4fff-907d-fe1ad6b17a90 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:10.861359 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f37718e6-dffc-4fff-907d-fe1ad6b17a90 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:10.861787 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f37718e6-dffc-4fff-907d-fe1ad6b17a90 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:10.862463 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f37718e6-dffc-4fff-907d-fe1ad6b17a90 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:10.862903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f37718e6-dffc-4fff-907d-fe1ad6b17a90 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:10.863321 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f37718e6-dffc-4fff-907d-fe1ad6b17a90 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:10.990221 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f37718e6-dffc-4fff-907d-fe1ad6b17a90 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:10.997625 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f37718e6-dffc-4fff-907d-fe1ad6b17a90 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.147184 Aug 17 08:39:10.998193 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 72/150] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:10 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:11.154283 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-333137f7-5c67-4d64-beba-5b76b7da4292 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Calling method '.version_select at 0x7f3f85e42d30>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:11.206889 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-333137f7-5c67-4d64-beba-5b76b7da4292 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746" status: 200 len: 345 microversion: 2.1 time: 0.056739 Aug 17 08:39:11.207747 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 79/151] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 08:39:11 2022] GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:39:12.018529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-be1fbad3-05d7-4fe8-be58-f563adaa879d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:12.019061 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-be1fbad3-05d7-4fe8-be58-f563adaa879d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:12.024996 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-be1fbad3-05d7-4fe8-be58-f563adaa879d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:12.025468 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-be1fbad3-05d7-4fe8-be58-f563adaa879d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:12.025895 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-be1fbad3-05d7-4fe8-be58-f563adaa879d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:12.026587 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-be1fbad3-05d7-4fe8-be58-f563adaa879d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:12.027014 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-be1fbad3-05d7-4fe8-be58-f563adaa879d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:12.027436 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-be1fbad3-05d7-4fe8-be58-f563adaa879d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:12.156802 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-be1fbad3-05d7-4fe8-be58-f563adaa879d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:12.167935 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-be1fbad3-05d7-4fe8-be58-f563adaa879d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.153263 Aug 17 08:39:12.168494 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 73/152] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:12 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:39:12.221800 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1b7253c7-a4db-4cdc-a5e6-767322cb0256 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Calling method '.version_select at 0x7f3f85e49820>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:12.272032 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1b7253c7-a4db-4cdc-a5e6-767322cb0256 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746" status: 200 len: 345 microversion: 2.1 time: 0.055035 Aug 17 08:39:12.272546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 80/153] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 08:39:12 2022] GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:39:13.190332 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-746eac93-0671-4342-8970-dcec20235e56 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:13.190936 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-746eac93-0671-4342-8970-dcec20235e56 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:13.196846 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-746eac93-0671-4342-8970-dcec20235e56 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:13.197323 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-746eac93-0671-4342-8970-dcec20235e56 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:13.197758 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-746eac93-0671-4342-8970-dcec20235e56 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:13.198445 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-746eac93-0671-4342-8970-dcec20235e56 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:13.198895 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-746eac93-0671-4342-8970-dcec20235e56 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:13.199315 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-746eac93-0671-4342-8970-dcec20235e56 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:13.286416 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3b6830f9-0458-42c4-a119-9f4a5b51c8a4 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Calling method '.version_select at 0x7f3f85e42ca0>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:13.337199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-746eac93-0671-4342-8970-dcec20235e56 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:13.337686 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3b6830f9-0458-42c4-a119-9f4a5b51c8a4 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746" status: 200 len: 345 microversion: 2.1 time: 0.055075 Aug 17 08:39:13.338464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 81/154] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 08:39:13 2022] GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:39:13.345456 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-746eac93-0671-4342-8970-dcec20235e56 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.159565 Aug 17 08:39:13.346022 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 74/155] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:13 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:14.351142 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a824645a-ccfe-4c02-aa4c-49d9166df056 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Calling method '.version_select at 0x7f3f85e3c1f0>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:14.365771 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c9e7b194-2e76-46dc-a2eb-bd04d9731edf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:14.366372 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c9e7b194-2e76-46dc-a2eb-bd04d9731edf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:14.372232 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c9e7b194-2e76-46dc-a2eb-bd04d9731edf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:14.372711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c9e7b194-2e76-46dc-a2eb-bd04d9731edf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:14.373141 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c9e7b194-2e76-46dc-a2eb-bd04d9731edf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:14.373816 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c9e7b194-2e76-46dc-a2eb-bd04d9731edf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:14.374261 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c9e7b194-2e76-46dc-a2eb-bd04d9731edf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:14.374675 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c9e7b194-2e76-46dc-a2eb-bd04d9731edf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:14.397605 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a824645a-ccfe-4c02-aa4c-49d9166df056 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746" status: 200 len: 345 microversion: 2.1 time: 0.050578 Aug 17 08:39:14.398162 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 82/156] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 08:39:14 2022] GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:39:14.504652 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c9e7b194-2e76-46dc-a2eb-bd04d9731edf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:14.511999 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c9e7b194-2e76-46dc-a2eb-bd04d9731edf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.149916 Aug 17 08:39:14.512559 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 75/157] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:14 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:15.412110 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-dfe6a93b-5f63-4925-b680-c2248f37283e tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Calling method '.version_select at 0x7f3f85ed6f70>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:15.497371 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-dfe6a93b-5f63-4925-b680-c2248f37283e tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746" status: 200 len: 346 microversion: 2.1 time: 0.089684 Aug 17 08:39:15.498358 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 83/158] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 08:39:15 2022] GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746 => generated 346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:39:15.517884 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ebd6f672-2d67-4365-8c34-c1adf03758dd tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Action: 'create', calling method: .version_select at 0x7f3f85644dc0>, body: {"snapshot": {"volume_id": "8c2408f8-9eb1-4eaf-a6a9-7587e3599746", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-238084196"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:39:15.533467 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6f22e935-0cb9-4480-ba89-f8d004437aff tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:15.534050 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6f22e935-0cb9-4480-ba89-f8d004437aff tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:15.542734 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6f22e935-0cb9-4480-ba89-f8d004437aff tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:15.543395 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6f22e935-0cb9-4480-ba89-f8d004437aff tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:15.544013 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6f22e935-0cb9-4480-ba89-f8d004437aff tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:15.544866 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6f22e935-0cb9-4480-ba89-f8d004437aff tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:15.545457 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6f22e935-0cb9-4480-ba89-f8d004437aff tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:15.546351 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6f22e935-0cb9-4480-ba89-f8d004437aff tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:15.713706 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6f22e935-0cb9-4480-ba89-f8d004437aff tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:15.721420 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6f22e935-0cb9-4480-ba89-f8d004437aff tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.192611 Aug 17 08:39:15.723677 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 84/159] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:15 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:39:15.738571 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ebd6f672-2d67-4365-8c34-c1adf03758dd tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.231008 Aug 17 08:39:15.739240 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 76/160] 10.222.0.15 () {60 vars in 1162 bytes} [Wed Aug 17 08:39:15 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:39:15.750014 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4f0a0fa0-776b-41f4-9c40-cb664fad4dd4 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Calling method '.version_select at 0x7f3f85f6c310>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:15.784081 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4f0a0fa0-776b-41f4-9c40-cb664fad4dd4 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/fdfa1533-62ce-48b4-9d52-1ebf1cd2b828" status: 200 len: 286 microversion: 2.1 time: 0.037832 Aug 17 08:39:15.784669 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 85/161] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 08:39:15 2022] GET /compute/v2.1/os-snapshots/fdfa1533-62ce-48b4-9d52-1ebf1cd2b828 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:39:15.796618 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-873da91f-783c-4a32-bdcb-02e5bc58e42d tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Calling method '.version_select at 0x7f3f8589d9d0>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:15.831604 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-873da91f-783c-4a32-bdcb-02e5bc58e42d tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.039580 Aug 17 08:39:15.832568 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 77/162] 10.222.0.15 () {58 vars in 1140 bytes} [Wed Aug 17 08:39:15 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:39:15.843065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d3a45b33-1c7a-4410-80c1-d50dcb4949e7 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Calling method '.version_select at 0x7f3f85e42940>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:15.877329 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d3a45b33-1c7a-4410-80c1-d50dcb4949e7 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/fdfa1533-62ce-48b4-9d52-1ebf1cd2b828" status: 200 len: 286 microversion: 2.1 time: 0.037816 Aug 17 08:39:15.878026 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 86/163] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 08:39:15 2022] GET /compute/v2.1/os-snapshots/fdfa1533-62ce-48b4-9d52-1ebf1cd2b828 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:39:16.744485 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-644868ad-9961-4401-b434-369079129444 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:16.746159 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-644868ad-9961-4401-b434-369079129444 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:16.765502 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-644868ad-9961-4401-b434-369079129444 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:16.766022 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-644868ad-9961-4401-b434-369079129444 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:16.766407 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-644868ad-9961-4401-b434-369079129444 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:16.767161 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-644868ad-9961-4401-b434-369079129444 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:16.767608 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-644868ad-9961-4401-b434-369079129444 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:16.768088 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-644868ad-9961-4401-b434-369079129444 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:16.893117 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e4c4eae5-afd6-41b5-93ad-344189fa164a tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Calling method '.version_select at 0x7f3f85f72280>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:16.915406 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-644868ad-9961-4401-b434-369079129444 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:16.923861 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-644868ad-9961-4401-b434-369079129444 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.183495 Aug 17 08:39:16.934864 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 78/164] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:16 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:16.946560 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e4c4eae5-afd6-41b5-93ad-344189fa164a tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/fdfa1533-62ce-48b4-9d52-1ebf1cd2b828" status: 200 len: 286 microversion: 2.1 time: 0.058650 Aug 17 08:39:16.947753 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 87/165] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 08:39:16 2022] GET /compute/v2.1/os-snapshots/fdfa1533-62ce-48b4-9d52-1ebf1cd2b828 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:39:17.945977 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d69e2538-82f9-48dd-9609-8c9c78c4a8c7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:17.946583 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d69e2538-82f9-48dd-9609-8c9c78c4a8c7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:17.952723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d69e2538-82f9-48dd-9609-8c9c78c4a8c7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:17.953386 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d69e2538-82f9-48dd-9609-8c9c78c4a8c7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:17.954007 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d69e2538-82f9-48dd-9609-8c9c78c4a8c7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:17.954906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d69e2538-82f9-48dd-9609-8c9c78c4a8c7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:17.955503 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d69e2538-82f9-48dd-9609-8c9c78c4a8c7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:17.956099 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d69e2538-82f9-48dd-9609-8c9c78c4a8c7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:17.959762 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2a4b13ef-5c7d-4969-ab70-767919a8c42e tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Calling method '.version_select at 0x7f3f85f6ca60>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:18.027768 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2a4b13ef-5c7d-4969-ab70-767919a8c42e tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/fdfa1533-62ce-48b4-9d52-1ebf1cd2b828" status: 200 len: 286 microversion: 2.1 time: 0.071708 Aug 17 08:39:18.028766 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 88/166] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 08:39:17 2022] GET /compute/v2.1/os-snapshots/fdfa1533-62ce-48b4-9d52-1ebf1cd2b828 => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:39:18.114333 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-d69e2538-82f9-48dd-9609-8c9c78c4a8c7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:18.123079 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d69e2538-82f9-48dd-9609-8c9c78c4a8c7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.181167 Aug 17 08:39:18.123779 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 79/167] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:17 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:19.041764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1433eaad-9ac2-412d-9390-4619ffdeca0d tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Calling method '.version_select at 0x7f3f85e421f0>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:19.077662 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1433eaad-9ac2-412d-9390-4619ffdeca0d tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/fdfa1533-62ce-48b4-9d52-1ebf1cd2b828" status: 200 len: 286 microversion: 2.1 time: 0.040042 Aug 17 08:39:19.083421 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 89/168] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 08:39:19 2022] GET /compute/v2.1/os-snapshots/fdfa1533-62ce-48b4-9d52-1ebf1cd2b828 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:39:19.144873 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a27e68c3-af40-4a8d-b7c8-00757aa011b4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:19.145890 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a27e68c3-af40-4a8d-b7c8-00757aa011b4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:19.152858 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a27e68c3-af40-4a8d-b7c8-00757aa011b4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:19.153684 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a27e68c3-af40-4a8d-b7c8-00757aa011b4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:19.154839 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a27e68c3-af40-4a8d-b7c8-00757aa011b4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:19.156208 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a27e68c3-af40-4a8d-b7c8-00757aa011b4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:19.156884 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a27e68c3-af40-4a8d-b7c8-00757aa011b4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:19.157528 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a27e68c3-af40-4a8d-b7c8-00757aa011b4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:19.163745 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=100 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:19.447201 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a27e68c3-af40-4a8d-b7c8-00757aa011b4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:19.465404 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a27e68c3-af40-4a8d-b7c8-00757aa011b4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.324024 Aug 17 08:39:19.471700 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 80/169] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:19 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:20.091776 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-63c68d64-6168-4628-a84a-0c1ceedbc8fb tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Calling method '.version_select at 0x7f3f860448b0>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:20.146010 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-63c68d64-6168-4628-a84a-0c1ceedbc8fb tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/fdfa1533-62ce-48b4-9d52-1ebf1cd2b828" status: 200 len: 287 microversion: 2.1 time: 0.058710 Aug 17 08:39:20.147281 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 90/170] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 08:39:20 2022] GET /compute/v2.1/os-snapshots/fdfa1533-62ce-48b4-9d52-1ebf1cd2b828 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:39:20.159112 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d596744f-3e83-4b66-aa56-0f83c07b2818 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Calling method '.version_select at 0x7f3f856444c0>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:20.265925 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d596744f-3e83-4b66-aa56-0f83c07b2818 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/fdfa1533-62ce-48b4-9d52-1ebf1cd2b828" status: 202 len: 0 microversion: 2.1 time: 0.111653 Aug 17 08:39:20.267189 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 81/171] 10.222.0.15 () {58 vars in 1254 bytes} [Wed Aug 17 08:39:20 2022] DELETE /compute/v2.1/os-snapshots/fdfa1533-62ce-48b4-9d52-1ebf1cd2b828 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 08:39:20.276621 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e67a1518-67b8-41e5-a6b8-db0b1f9bda59 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Calling method '.version_select at 0x7f3f85ed69d0>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:20.316317 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e67a1518-67b8-41e5-a6b8-db0b1f9bda59 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/fdfa1533-62ce-48b4-9d52-1ebf1cd2b828" status: 200 len: 286 microversion: 2.1 time: 0.044009 Aug 17 08:39:20.316885 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 91/172] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 08:39:20 2022] GET /compute/v2.1/os-snapshots/fdfa1533-62ce-48b4-9d52-1ebf1cd2b828 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:39:20.490914 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8b3bbf5d-6df7-4cdc-97d0-ee4dde501f61 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:20.491509 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8b3bbf5d-6df7-4cdc-97d0-ee4dde501f61 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:20.497851 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8b3bbf5d-6df7-4cdc-97d0-ee4dde501f61 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:20.498645 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8b3bbf5d-6df7-4cdc-97d0-ee4dde501f61 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:20.499326 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8b3bbf5d-6df7-4cdc-97d0-ee4dde501f61 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:20.500523 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8b3bbf5d-6df7-4cdc-97d0-ee4dde501f61 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:20.501989 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8b3bbf5d-6df7-4cdc-97d0-ee4dde501f61 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:20.503521 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8b3bbf5d-6df7-4cdc-97d0-ee4dde501f61 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:20.859421 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8b3bbf5d-6df7-4cdc-97d0-ee4dde501f61 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:20.871498 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8b3bbf5d-6df7-4cdc-97d0-ee4dde501f61 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.383881 Aug 17 08:39:20.872476 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 82/173] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:20 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:21.331710 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3a3b8c78-9ae0-4b80-9f60-d3aa3ec1e246 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Calling method '.version_select at 0x7f3f860441f0>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:21.379227 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-3a3b8c78-9ae0-4b80-9f60-d3aa3ec1e246 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] HTTP exception thrown: Snapshot fdfa1533-62ce-48b4-9d52-1ebf1cd2b828 could not be found. Aug 17 08:39:21.381412 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3a3b8c78-9ae0-4b80-9f60-d3aa3ec1e246 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Request method failure captured: Aug 17 08:39:21.381412 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/os-snapshots/fdfa1533-62ce-48b4-9d52-1ebf1cd2b828 HTTP/1.1 Aug 17 08:39:21.381412 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:39:21.381412 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:39:21.381412 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:39:21.381412 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:39:21.381412 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:39:21.381412 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:39:21.381412 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:39:21.381412 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:39:21.381412 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_KkqLjlo3Cq4nPYF03CsGQqRTfJHQcEYz5g1pZnfLDaIocKGfvcpDp2dv-1i_DlNyOEEdZzYn5cctt48Pdn8ULC_pY1XhyQq5zfIoaFk7ho_8G7vBoB_HQpa_zqw_Eaqzv4CcyGzQDBgsZi9k2txoUaXXLbsoSkVlVtW8x97Tk3TTLU Aug 17 08:39:21.381412 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:39:21.381412 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:39:21.381412 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:39:21.381412 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:39:21.381412 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:39:21.381412 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:39:21.381412 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: 5f4a18aee24d4fd3a7fdeeb18ef36a34 Aug 17 08:39:21.381412 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-787787212 Aug 17 08:39:21.381412 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:39:21.381412 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:39:21.382757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5f4a18aee24d4fd3a7fdeeb18ef36a34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5f4a18aee24d4fd3a7fdeeb18ef36a34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5f4a18aee24d4fd3a7fdeeb18ef36a34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5f4a18aee24d4fd3a7fdeeb18ef36a34", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:39:21.382757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-VolumesSnapshotsTestJSON-787787212 Aug 17 08:39:21.382757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 5f4a18aee24d4fd3a7fdeeb18ef36a34 Aug 17 08:39:21.382757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-787787212 Aug 17 08:39:21.382757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-VolumesSnapshotsTestJSON-787787212-project Aug 17 08:39:21.382757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:39:21.382757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:39:21.382757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: 5aadd607eaef41b6b84b00a89d0a3ed2 Aug 17 08:39:21.382757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-VolumesSnapshotsTestJSON-787787212-project Aug 17 08:39:21.382757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: Aug 17 08:39:21.382757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Snapshot fdfa1533-62ce-48b4-9d52-1ebf1cd2b828 could not be found. Aug 17 08:39:21.382757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': 'fdfa1533-62ce-48b4-9d52-1ebf1cd2b828'} Aug 17 08:39:21.382757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:39:21.383764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:39:21.383764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 17 08:39:21.383764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 17 08:39:21.383764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 17 08:39:21.383764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 17 08:39:21.383764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 17 08:39:21.383764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 17 08:39:21.383764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 08:39:21.383764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 08:39:21.383764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 08:39:21.383764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 08:39:21.383764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 08:39:21.383764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 08:39:21.383764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 08:39:21.383764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 08:39:21.383764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fdfa1533-62ce-48b4-9d52-1ebf1cd2b828 could not be found. (HTTP 404) (Request-ID: req-e40d3e0f-258f-403e-8b05-8185ca421705) Aug 17 08:39:21.383764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:21.383764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:39:21.385041 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:21.385041 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:39:21.385041 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 17 08:39:21.385041 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 17 08:39:21.385041 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 08:39:21.385041 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 08:39:21.385041 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 17 08:39:21.385041 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 17 08:39:21.385041 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 08:39:21.385041 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 08:39:21.385041 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 17 08:39:21.385041 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 17 08:39:21.385041 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 17 08:39:21.385041 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 17 08:39:21.385041 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 17 08:39:21.385041 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 17 08:39:21.385041 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 08:39:21.385041 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 08:39:21.385041 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 08:39:21.386286 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 08:39:21.386286 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 08:39:21.386286 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 08:39:21.386286 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 08:39:21.386286 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 08:39:21.386286 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fdfa1533-62ce-48b4-9d52-1ebf1cd2b828 could not be found. Aug 17 08:39:21.386286 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:21.386286 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:39:21.386286 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:21.386286 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:39:21.386286 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:39:21.386286 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:39:21.386286 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:39:21.386286 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:39:21.386286 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 08:39:21.386286 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 08:39:21.386286 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:39:21.386286 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:39:21.386286 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 17 08:39:21.386286 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:39:21.387496 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fdfa1533-62ce-48b4-9d52-1ebf1cd2b828 could not be found. Aug 17 08:39:21.387496 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:21.387496 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:39:21.387496 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:21.387496 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:39:21.387496 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:39:21.387496 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:39:21.387496 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:39:21.387496 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:39:21.387496 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fdfa1533-62ce-48b4-9d52-1ebf1cd2b828 could not be found. Aug 17 08:39:21.387496 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:21.389212 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3a3b8c78-9ae0-4b80-9f60-d3aa3ec1e246 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Returning 404 to user: Snapshot fdfa1533-62ce-48b4-9d52-1ebf1cd2b828 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:39:21.390223 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3a3b8c78-9ae0-4b80-9f60-d3aa3ec1e246 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/fdfa1533-62ce-48b4-9d52-1ebf1cd2b828" status: 404 len: 111 microversion: 2.1 time: 0.064138 Aug 17 08:39:21.394303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 92/174] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 08:39:21 2022] GET /compute/v2.1/os-snapshots/fdfa1533-62ce-48b4-9d52-1ebf1cd2b828 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:39:21.399311 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-dbf277cd-7208-4a97-aa45-484d2e2b2038 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Calling method '.version_select at 0x7f3f85644f70>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:21.493238 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-dbf277cd-7208-4a97-aa45-484d2e2b2038 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746" status: 202 len: 0 microversion: 2.1 time: 0.098034 Aug 17 08:39:21.494160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 83/175] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 08:39:21 2022] DELETE /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:39:21.505852 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d2b21f28-6280-49b7-b091-664a1226c4cc tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Calling method '.version_select at 0x7f3f86041700>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:21.568774 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d2b21f28-6280-49b7-b091-664a1226c4cc tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746" status: 200 len: 345 microversion: 2.1 time: 0.070111 Aug 17 08:39:21.569536 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 93/176] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 08:39:21 2022] GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746 => generated 345 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:39:21.892916 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-09bff5e0-20da-46c5-a677-6c351c71e9ea tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:21.894154 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-09bff5e0-20da-46c5-a677-6c351c71e9ea tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:21.903863 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:21.906224 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-09bff5e0-20da-46c5-a677-6c351c71e9ea tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:21.908653 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-09bff5e0-20da-46c5-a677-6c351c71e9ea tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:21.910518 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-09bff5e0-20da-46c5-a677-6c351c71e9ea tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:21.911948 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-09bff5e0-20da-46c5-a677-6c351c71e9ea tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:21.913509 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-09bff5e0-20da-46c5-a677-6c351c71e9ea tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:21.926575 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-09bff5e0-20da-46c5-a677-6c351c71e9ea tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:22.269803 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-09bff5e0-20da-46c5-a677-6c351c71e9ea tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:22.278893 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-09bff5e0-20da-46c5-a677-6c351c71e9ea tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1520 microversion: 2.1 time: 0.389714 Aug 17 08:39:22.283865 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 84/177] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:21 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1520 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:39:22.593269 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d9fd714d-a4cf-4eaa-8426-e54cb7ec7822 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Calling method '.version_select at 0x7f3f85ed6550>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:22.655121 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-d9fd714d-a4cf-4eaa-8426-e54cb7ec7822 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] HTTP exception thrown: Volume 8c2408f8-9eb1-4eaf-a6a9-7587e3599746 could not be found. Aug 17 08:39:22.657127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d9fd714d-a4cf-4eaa-8426-e54cb7ec7822 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Request method failure captured: Aug 17 08:39:22.657127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746 HTTP/1.1 Aug 17 08:39:22.657127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:39:22.657127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:39:22.657127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:39:22.657127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:39:22.657127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:39:22.657127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:39:22.657127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:39:22.657127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:39:22.657127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_KkqLjlo3Cq4nPYF03CsGQqRTfJHQcEYz5g1pZnfLDaIocKGfvcpDp2dv-1i_DlNyOEEdZzYn5cctt48Pdn8ULC_pY1XhyQq5zfIoaFk7ho_8G7vBoB_HQpa_zqw_Eaqzv4CcyGzQDBgsZi9k2txoUaXXLbsoSkVlVtW8x97Tk3TTLU Aug 17 08:39:22.657127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:39:22.657127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:39:22.657127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:39:22.657127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:39:22.657127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:39:22.657127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:39:22.657127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: 5f4a18aee24d4fd3a7fdeeb18ef36a34 Aug 17 08:39:22.657127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-787787212 Aug 17 08:39:22.657127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:39:22.657127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:39:22.658395 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5f4a18aee24d4fd3a7fdeeb18ef36a34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5f4a18aee24d4fd3a7fdeeb18ef36a34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5f4a18aee24d4fd3a7fdeeb18ef36a34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5f4a18aee24d4fd3a7fdeeb18ef36a34", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:39:22.658395 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-VolumesSnapshotsTestJSON-787787212 Aug 17 08:39:22.658395 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 5f4a18aee24d4fd3a7fdeeb18ef36a34 Aug 17 08:39:22.658395 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-787787212 Aug 17 08:39:22.658395 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-VolumesSnapshotsTestJSON-787787212-project Aug 17 08:39:22.658395 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:39:22.658395 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:39:22.658395 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: 5aadd607eaef41b6b84b00a89d0a3ed2 Aug 17 08:39:22.658395 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-VolumesSnapshotsTestJSON-787787212-project Aug 17 08:39:22.658395 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: Aug 17 08:39:22.658395 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Volume 8c2408f8-9eb1-4eaf-a6a9-7587e3599746 could not be found. Aug 17 08:39:22.658395 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': '8c2408f8-9eb1-4eaf-a6a9-7587e3599746'} Aug 17 08:39:22.658395 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:39:22.659168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:39:22.659168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 08:39:22.659168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 08:39:22.659168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 08:39:22.659168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 08:39:22.659168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 08:39:22.659168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 08:39:22.659168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 08:39:22.659168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 08:39:22.659168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 08:39:22.659168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 08:39:22.659168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 08:39:22.659168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 08:39:22.659168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 08:39:22.659168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 08:39:22.659168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c2408f8-9eb1-4eaf-a6a9-7587e3599746 could not be found. (HTTP 404) (Request-ID: req-e6bf8402-6787-490e-acf3-98171db110b3) Aug 17 08:39:22.659168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:22.659168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:39:22.659168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:22.660270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:39:22.660270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 08:39:22.660270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 08:39:22.660270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 08:39:22.660270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 08:39:22.660270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 08:39:22.660270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 08:39:22.660270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 08:39:22.660270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 08:39:22.660270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 08:39:22.660270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 08:39:22.660270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 08:39:22.660270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 08:39:22.660270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 08:39:22.660270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 08:39:22.660270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 08:39:22.660270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 08:39:22.660270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 08:39:22.660270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 08:39:22.661297 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 08:39:22.661297 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 08:39:22.661297 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 08:39:22.661297 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 08:39:22.661297 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c2408f8-9eb1-4eaf-a6a9-7587e3599746 could not be found. Aug 17 08:39:22.661297 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:22.661297 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:39:22.661297 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:22.661297 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:39:22.661297 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:39:22.661297 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:39:22.661297 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:39:22.661297 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:39:22.661297 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 08:39:22.661297 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 08:39:22.661297 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:39:22.661297 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:39:22.661297 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 08:39:22.661297 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:39:22.662339 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c2408f8-9eb1-4eaf-a6a9-7587e3599746 could not be found. Aug 17 08:39:22.662339 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:22.662339 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:39:22.662339 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:22.662339 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:39:22.662339 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:39:22.662339 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:39:22.662339 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:39:22.662339 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:39:22.662339 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c2408f8-9eb1-4eaf-a6a9-7587e3599746 could not be found. Aug 17 08:39:22.662339 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:22.662339 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d9fd714d-a4cf-4eaa-8426-e54cb7ec7822 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Returning 404 to user: Volume 8c2408f8-9eb1-4eaf-a6a9-7587e3599746 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:39:22.662339 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d9fd714d-a4cf-4eaa-8426-e54cb7ec7822 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746" status: 404 len: 109 microversion: 2.1 time: 0.079867 Aug 17 08:39:22.662339 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 94/178] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 08:39:22 2022] GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:39:22.679975 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d0e02727-d9f1-40d7-88f6-fa696a58bbba tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Calling method '.version_select at 0x7f3f85644310>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:22.731837 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-d0e02727-d9f1-40d7-88f6-fa696a58bbba tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] HTTP exception thrown: Volume 8c2408f8-9eb1-4eaf-a6a9-7587e3599746 could not be found. Aug 17 08:39:22.739290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d0e02727-d9f1-40d7-88f6-fa696a58bbba tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Request method failure captured: Aug 17 08:39:22.739290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: DELETE /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746 HTTP/1.1 Aug 17 08:39:22.739290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:39:22.739290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:39:22.739290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:39:22.739290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:39:22.739290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:39:22.739290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:39:22.739290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:39:22.739290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:39:22.739290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_KkqLjlo3Cq4nPYF03CsGQqRTfJHQcEYz5g1pZnfLDaIocKGfvcpDp2dv-1i_DlNyOEEdZzYn5cctt48Pdn8ULC_pY1XhyQq5zfIoaFk7ho_8G7vBoB_HQpa_zqw_Eaqzv4CcyGzQDBgsZi9k2txoUaXXLbsoSkVlVtW8x97Tk3TTLU Aug 17 08:39:22.739290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:39:22.739290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:39:22.739290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:39:22.739290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:39:22.739290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:39:22.739290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:39:22.739290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: 5f4a18aee24d4fd3a7fdeeb18ef36a34 Aug 17 08:39:22.739290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-787787212 Aug 17 08:39:22.739290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:39:22.739290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:39:22.740659 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5f4a18aee24d4fd3a7fdeeb18ef36a34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5f4a18aee24d4fd3a7fdeeb18ef36a34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5f4a18aee24d4fd3a7fdeeb18ef36a34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5f4a18aee24d4fd3a7fdeeb18ef36a34", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:39:22.740659 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-VolumesSnapshotsTestJSON-787787212 Aug 17 08:39:22.740659 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 5f4a18aee24d4fd3a7fdeeb18ef36a34 Aug 17 08:39:22.740659 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-787787212 Aug 17 08:39:22.740659 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-VolumesSnapshotsTestJSON-787787212-project Aug 17 08:39:22.740659 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:39:22.740659 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:39:22.740659 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: 5aadd607eaef41b6b84b00a89d0a3ed2 Aug 17 08:39:22.740659 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-VolumesSnapshotsTestJSON-787787212-project Aug 17 08:39:22.740659 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: Aug 17 08:39:22.740659 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Volume 8c2408f8-9eb1-4eaf-a6a9-7587e3599746 could not be found. Aug 17 08:39:22.740659 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'id': '8c2408f8-9eb1-4eaf-a6a9-7587e3599746'} Aug 17 08:39:22.740659 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:39:22.741378 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:39:22.741378 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 08:39:22.741378 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 08:39:22.741378 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 08:39:22.741378 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 08:39:22.741378 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 08:39:22.741378 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 08:39:22.741378 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 08:39:22.741378 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 08:39:22.741378 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 08:39:22.741378 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 08:39:22.741378 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 08:39:22.741378 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 08:39:22.741378 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 08:39:22.741378 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 08:39:22.741378 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c2408f8-9eb1-4eaf-a6a9-7587e3599746 could not be found. (HTTP 404) (Request-ID: req-c4d2f8e8-8b2d-4d0b-89df-fda7acefafab) Aug 17 08:39:22.741378 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:39:22.741378 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:39:22.741378 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:39:22.747690 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:39:22.747690 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 08:39:22.747690 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 08:39:22.747690 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 08:39:22.747690 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 08:39:22.747690 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 08:39:22.747690 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 08:39:22.747690 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 08:39:22.747690 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 08:39:22.747690 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 08:39:22.747690 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 08:39:22.747690 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 08:39:22.747690 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 08:39:22.747690 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 08:39:22.747690 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 08:39:22.747690 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 08:39:22.747690 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 08:39:22.747690 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 08:39:22.747690 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 08:39:22.752743 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 08:39:22.752743 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 08:39:22.752743 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 08:39:22.752743 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 08:39:22.752743 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c2408f8-9eb1-4eaf-a6a9-7587e3599746 could not be found. Aug 17 08:39:22.752743 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:39:22.752743 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:39:22.752743 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:39:22.752743 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:39:22.752743 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:39:22.752743 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:39:22.752743 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:39:22.752743 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:39:22.752743 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 08:39:22.752743 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 08:39:22.752743 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:39:22.752743 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:39:22.752743 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 08:39:22.752743 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:39:22.754906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c2408f8-9eb1-4eaf-a6a9-7587e3599746 could not be found. Aug 17 08:39:22.754906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:39:22.754906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:39:22.754906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:39:22.754906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:39:22.754906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:39:22.754906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:39:22.754906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:39:22.754906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:39:22.754906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c2408f8-9eb1-4eaf-a6a9-7587e3599746 could not be found. Aug 17 08:39:22.754906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:39:22.754906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d0e02727-d9f1-40d7-88f6-fa696a58bbba tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Returning 404 to user: Volume 8c2408f8-9eb1-4eaf-a6a9-7587e3599746 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:39:22.754906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d0e02727-d9f1-40d7-88f6-fa696a58bbba tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746" status: 404 len: 109 microversion: 2.1 time: 0.068423 Aug 17 08:39:22.754906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 85/179] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 08:39:22 2022] DELETE /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:39:22.756921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-73eb476c-2666-43b4-aed5-a0f6b384d239 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Calling method '.version_select at 0x7f3f85e42e50>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:22.804215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-73eb476c-2666-43b4-aed5-a0f6b384d239 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] HTTP exception thrown: Volume 8c2408f8-9eb1-4eaf-a6a9-7587e3599746 could not be found. Aug 17 08:39:22.806858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-73eb476c-2666-43b4-aed5-a0f6b384d239 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Request method failure captured: Aug 17 08:39:22.806858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746 HTTP/1.1 Aug 17 08:39:22.806858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:39:22.806858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:39:22.806858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:39:22.806858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:39:22.806858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:39:22.806858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:39:22.806858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:39:22.806858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:39:22.806858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_KkqLjlo3Cq4nPYF03CsGQqRTfJHQcEYz5g1pZnfLDaIocKGfvcpDp2dv-1i_DlNyOEEdZzYn5cctt48Pdn8ULC_pY1XhyQq5zfIoaFk7ho_8G7vBoB_HQpa_zqw_Eaqzv4CcyGzQDBgsZi9k2txoUaXXLbsoSkVlVtW8x97Tk3TTLU Aug 17 08:39:22.806858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:39:22.806858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:39:22.806858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:39:22.806858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:39:22.806858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:39:22.806858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:39:22.806858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: 5f4a18aee24d4fd3a7fdeeb18ef36a34 Aug 17 08:39:22.806858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-787787212 Aug 17 08:39:22.806858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:39:22.806858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:39:22.808113 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5f4a18aee24d4fd3a7fdeeb18ef36a34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5f4a18aee24d4fd3a7fdeeb18ef36a34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5f4a18aee24d4fd3a7fdeeb18ef36a34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5f4a18aee24d4fd3a7fdeeb18ef36a34", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:39:22.808113 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-VolumesSnapshotsTestJSON-787787212 Aug 17 08:39:22.808113 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 5f4a18aee24d4fd3a7fdeeb18ef36a34 Aug 17 08:39:22.808113 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-787787212 Aug 17 08:39:22.808113 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-VolumesSnapshotsTestJSON-787787212-project Aug 17 08:39:22.808113 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:39:22.808113 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:39:22.808113 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: 5aadd607eaef41b6b84b00a89d0a3ed2 Aug 17 08:39:22.808113 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-VolumesSnapshotsTestJSON-787787212-project Aug 17 08:39:22.808113 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: Aug 17 08:39:22.808113 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Volume 8c2408f8-9eb1-4eaf-a6a9-7587e3599746 could not be found. Aug 17 08:39:22.808113 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': '8c2408f8-9eb1-4eaf-a6a9-7587e3599746'} Aug 17 08:39:22.808113 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:39:22.808837 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:39:22.808837 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 08:39:22.808837 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 08:39:22.808837 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 08:39:22.808837 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 08:39:22.808837 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 08:39:22.808837 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 08:39:22.808837 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 08:39:22.808837 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 08:39:22.808837 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 08:39:22.808837 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 08:39:22.808837 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 08:39:22.808837 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 08:39:22.808837 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 08:39:22.808837 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 08:39:22.808837 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c2408f8-9eb1-4eaf-a6a9-7587e3599746 could not be found. (HTTP 404) (Request-ID: req-a3495c50-7157-43d8-bca2-20e6cb41e870) Aug 17 08:39:22.808837 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:22.808837 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:39:22.808837 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:22.809855 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:39:22.809855 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 08:39:22.809855 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 08:39:22.809855 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 08:39:22.809855 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 08:39:22.809855 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 08:39:22.809855 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 08:39:22.809855 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 08:39:22.809855 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 08:39:22.809855 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 08:39:22.809855 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 08:39:22.809855 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 08:39:22.809855 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 08:39:22.809855 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 08:39:22.809855 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 08:39:22.809855 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 08:39:22.809855 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 08:39:22.809855 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 08:39:22.809855 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 08:39:22.810860 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 08:39:22.810860 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 08:39:22.810860 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 08:39:22.810860 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 08:39:22.810860 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c2408f8-9eb1-4eaf-a6a9-7587e3599746 could not be found. Aug 17 08:39:22.810860 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:22.810860 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:39:22.810860 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:22.810860 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:39:22.810860 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:39:22.810860 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:39:22.810860 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:39:22.810860 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:39:22.810860 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 08:39:22.810860 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 08:39:22.810860 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:39:22.810860 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:39:22.810860 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 08:39:22.810860 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:39:22.811920 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c2408f8-9eb1-4eaf-a6a9-7587e3599746 could not be found. Aug 17 08:39:22.811920 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:22.811920 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:39:22.811920 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:22.811920 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:39:22.811920 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:39:22.811920 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:39:22.811920 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:39:22.811920 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:39:22.811920 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c2408f8-9eb1-4eaf-a6a9-7587e3599746 could not be found. Aug 17 08:39:22.811920 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:22.811920 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-73eb476c-2666-43b4-aed5-a0f6b384d239 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] Returning 404 to user: Volume 8c2408f8-9eb1-4eaf-a6a9-7587e3599746 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:39:22.811920 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-73eb476c-2666-43b4-aed5-a0f6b384d239 tempest-VolumesSnapshotsTestJSON-787787212 tempest-VolumesSnapshotsTestJSON-787787212-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746" status: 404 len: 109 microversion: 2.1 time: 0.062374 Aug 17 08:39:22.811920 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 95/180] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 08:39:22 2022] GET /compute/v2.1/os-volumes/8c2408f8-9eb1-4eaf-a6a9-7587e3599746 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:39:23.309842 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-fbcdc00c-886a-46de-bf3d-dfbf287e253d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:23.310441 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-fbcdc00c-886a-46de-bf3d-dfbf287e253d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:23.350845 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fbcdc00c-886a-46de-bf3d-dfbf287e253d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:23.352488 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fbcdc00c-886a-46de-bf3d-dfbf287e253d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:23.353121 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fbcdc00c-886a-46de-bf3d-dfbf287e253d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:23.354807 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fbcdc00c-886a-46de-bf3d-dfbf287e253d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:23.355643 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fbcdc00c-886a-46de-bf3d-dfbf287e253d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:23.357815 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fbcdc00c-886a-46de-bf3d-dfbf287e253d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:24.011502 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-fbcdc00c-886a-46de-bf3d-dfbf287e253d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:24.026013 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-fbcdc00c-886a-46de-bf3d-dfbf287e253d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1500 microversion: 2.1 time: 0.719938 Aug 17 08:39:24.034534 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 86/181] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:23 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1500 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:24.061279 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8ef35de5-bece-4629-add1-7460110a8f40 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:24.062616 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8ef35de5-bece-4629-add1-7460110a8f40 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:24.076934 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8ef35de5-bece-4629-add1-7460110a8f40 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:24.077420 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8ef35de5-bece-4629-add1-7460110a8f40 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:24.080536 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8ef35de5-bece-4629-add1-7460110a8f40 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:24.081460 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8ef35de5-bece-4629-add1-7460110a8f40 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:24.082076 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8ef35de5-bece-4629-add1-7460110a8f40 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:24.083447 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8ef35de5-bece-4629-add1-7460110a8f40 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:24.601733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8ef35de5-bece-4629-add1-7460110a8f40 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:24.605006 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=57 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:24.626007 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8ef35de5-bece-4629-add1-7460110a8f40 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1516 microversion: 2.1 time: 0.569395 Aug 17 08:39:24.648280 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 96/182] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:24 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1516 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:26.453062 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e699f1a7-1c94-4f92-9604-790febbc0e87 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:39:26.457699 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e699f1a7-1c94-4f92-9604-790febbc0e87 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:26.465734 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e699f1a7-1c94-4f92-9604-790febbc0e87 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:26.467267 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e699f1a7-1c94-4f92-9604-790febbc0e87 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:26.468038 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e699f1a7-1c94-4f92-9604-790febbc0e87 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:26.468933 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e699f1a7-1c94-4f92-9604-790febbc0e87 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:26.469632 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e699f1a7-1c94-4f92-9604-790febbc0e87 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:26.470283 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e699f1a7-1c94-4f92-9604-790febbc0e87 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:26.504298 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-e699f1a7-1c94-4f92-9604-790febbc0e87 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lazy-loading 'flavor' on Instance uuid fcce3821-0099-45bc-9283-1ad5632080ce {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:39:26.634903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e699f1a7-1c94-4f92-9604-790febbc0e87 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "POST /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce/action" status: 200 len: 32 microversion: 2.1 time: 0.187113 Aug 17 08:39:26.635924 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 87/183] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 08:39:26 2022] POST /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce/action => generated 32 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 08:39:26.646398 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-581e7e89-0182-4344-853a-164309e8d996 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:26.647733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-581e7e89-0182-4344-853a-164309e8d996 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:26.658819 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=20 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:26.666821 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-581e7e89-0182-4344-853a-164309e8d996 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:26.668663 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-581e7e89-0182-4344-853a-164309e8d996 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:26.670041 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-581e7e89-0182-4344-853a-164309e8d996 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:26.671058 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-581e7e89-0182-4344-853a-164309e8d996 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:26.672319 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-581e7e89-0182-4344-853a-164309e8d996 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:26.673966 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-581e7e89-0182-4344-853a-164309e8d996 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:26.968417 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-581e7e89-0182-4344-853a-164309e8d996 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:26.988315 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-581e7e89-0182-4344-853a-164309e8d996 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1522 microversion: 2.1 time: 0.342959 Aug 17 08:39:26.988955 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 97/184] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:26 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:28.010949 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0206b6c9-aaee-449a-a946-21d5bb6f2650 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:28.012265 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0206b6c9-aaee-449a-a946-21d5bb6f2650 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:28.025403 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0206b6c9-aaee-449a-a946-21d5bb6f2650 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:28.028073 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0206b6c9-aaee-449a-a946-21d5bb6f2650 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:28.030538 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0206b6c9-aaee-449a-a946-21d5bb6f2650 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:28.031696 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0206b6c9-aaee-449a-a946-21d5bb6f2650 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:28.033918 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0206b6c9-aaee-449a-a946-21d5bb6f2650 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:28.034784 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0206b6c9-aaee-449a-a946-21d5bb6f2650 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:28.386609 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0206b6c9-aaee-449a-a946-21d5bb6f2650 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:28.395055 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0206b6c9-aaee-449a-a946-21d5bb6f2650 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1522 microversion: 2.1 time: 0.388866 Aug 17 08:39:28.402653 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 88/185] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:28 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:29.423759 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4228249a-9186-4bc1-990f-00ee4dc1d7aa tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:29.424563 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-4228249a-9186-4bc1-990f-00ee4dc1d7aa tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:29.441801 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4228249a-9186-4bc1-990f-00ee4dc1d7aa tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:29.456401 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4228249a-9186-4bc1-990f-00ee4dc1d7aa tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:29.457445 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4228249a-9186-4bc1-990f-00ee4dc1d7aa tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:29.458385 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4228249a-9186-4bc1-990f-00ee4dc1d7aa tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:29.459017 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4228249a-9186-4bc1-990f-00ee4dc1d7aa tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:29.462942 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4228249a-9186-4bc1-990f-00ee4dc1d7aa tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:29.862483 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-4228249a-9186-4bc1-990f-00ee4dc1d7aa tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:29.874117 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4228249a-9186-4bc1-990f-00ee4dc1d7aa tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1522 microversion: 2.1 time: 0.455292 Aug 17 08:39:29.877754 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 98/186] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:29 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:29.895052 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5e39048e-a3a8-4553-82f3-3caef4ac448d tempest-VolumesTestJSON-1690999997 tempest-VolumesTestJSON-1690999997-project] Calling method '.version_select at 0x7f3f857ff280>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:30.013945 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5e39048e-a3a8-4553-82f3-3caef4ac448d tempest-VolumesTestJSON-1690999997 tempest-VolumesTestJSON-1690999997-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/59b6f39c-4c20-452e-b75a-77d0c7117817" status: 200 len: 351 microversion: 2.1 time: 0.115195 Aug 17 08:39:30.013945 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 89/187] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 08:39:29 2022] GET /compute/v2.1/os-volumes/59b6f39c-4c20-452e-b75a-77d0c7117817 => generated 351 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:39:30.900461 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ec7dce3e-3416-448e-9205-0f8a7cbafe99 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:30.901824 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ec7dce3e-3416-448e-9205-0f8a7cbafe99 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:30.921635 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ec7dce3e-3416-448e-9205-0f8a7cbafe99 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:30.922423 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ec7dce3e-3416-448e-9205-0f8a7cbafe99 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:30.923124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ec7dce3e-3416-448e-9205-0f8a7cbafe99 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:30.924295 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ec7dce3e-3416-448e-9205-0f8a7cbafe99 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:30.924964 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ec7dce3e-3416-448e-9205-0f8a7cbafe99 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:30.925612 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ec7dce3e-3416-448e-9205-0f8a7cbafe99 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:31.206265 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ec7dce3e-3416-448e-9205-0f8a7cbafe99 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:31.220314 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ec7dce3e-3416-448e-9205-0f8a7cbafe99 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1522 microversion: 2.1 time: 0.323582 Aug 17 08:39:31.222656 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 99/188] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:30 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:39:32.251413 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9c7725cf-44f6-4d18-a635-51606b163f96 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:32.252309 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9c7725cf-44f6-4d18-a635-51606b163f96 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:32.265637 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9c7725cf-44f6-4d18-a635-51606b163f96 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:32.268992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9c7725cf-44f6-4d18-a635-51606b163f96 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:32.269681 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9c7725cf-44f6-4d18-a635-51606b163f96 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:32.271271 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9c7725cf-44f6-4d18-a635-51606b163f96 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:32.272121 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9c7725cf-44f6-4d18-a635-51606b163f96 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:32.273189 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9c7725cf-44f6-4d18-a635-51606b163f96 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:32.561274 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-9c7725cf-44f6-4d18-a635-51606b163f96 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:32.569078 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9c7725cf-44f6-4d18-a635-51606b163f96 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1522 microversion: 2.1 time: 0.327540 Aug 17 08:39:32.569657 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 90/189] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:32 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:33.590719 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-cbd72b92-7fef-4b64-9956-82eef0b6e617 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:33.591928 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-cbd72b92-7fef-4b64-9956-82eef0b6e617 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:33.605195 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cbd72b92-7fef-4b64-9956-82eef0b6e617 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:33.606001 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cbd72b92-7fef-4b64-9956-82eef0b6e617 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:33.606587 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cbd72b92-7fef-4b64-9956-82eef0b6e617 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:33.607438 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cbd72b92-7fef-4b64-9956-82eef0b6e617 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:33.608060 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cbd72b92-7fef-4b64-9956-82eef0b6e617 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:33.610733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cbd72b92-7fef-4b64-9956-82eef0b6e617 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:34.077098 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-cbd72b92-7fef-4b64-9956-82eef0b6e617 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:34.098679 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-cbd72b92-7fef-4b64-9956-82eef0b6e617 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1522 microversion: 2.1 time: 0.511829 Aug 17 08:39:34.099840 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 100/190] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:33 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1522 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:35.123723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e2f4f7fc-1ce1-4f67-951a-7e8fef0525ef tempest-VolumesTestJSON-1690999997 tempest-VolumesTestJSON-1690999997-project] Calling method '.version_select at 0x7f3f85631b80>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:35.126379 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-543e28d6-d16b-449a-84e8-a29ac3d9426a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:35.126984 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-543e28d6-d16b-449a-84e8-a29ac3d9426a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:35.136790 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-543e28d6-d16b-449a-84e8-a29ac3d9426a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:35.137291 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-543e28d6-d16b-449a-84e8-a29ac3d9426a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:35.137683 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-543e28d6-d16b-449a-84e8-a29ac3d9426a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:35.138378 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-543e28d6-d16b-449a-84e8-a29ac3d9426a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:35.138820 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-543e28d6-d16b-449a-84e8-a29ac3d9426a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:35.139219 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-543e28d6-d16b-449a-84e8-a29ac3d9426a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:35.230151 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e2f4f7fc-1ce1-4f67-951a-7e8fef0525ef tempest-VolumesTestJSON-1690999997 tempest-VolumesTestJSON-1690999997-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/f0e9ae1f-a9ef-4c1e-8ff6-2d30f309615a" status: 200 len: 350 microversion: 2.1 time: 0.116027 Aug 17 08:39:35.244764 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 91/191] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 08:39:35 2022] GET /compute/v2.1/os-volumes/f0e9ae1f-a9ef-4c1e-8ff6-2d30f309615a => generated 350 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:39:35.361923 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-68e29528-ddee-4504-9ac2-2cb3bac9e0cb tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:35.362792 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-68e29528-ddee-4504-9ac2-2cb3bac9e0cb tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:35.381381 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-68e29528-ddee-4504-9ac2-2cb3bac9e0cb tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:35.383491 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-68e29528-ddee-4504-9ac2-2cb3bac9e0cb tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:35.384261 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-68e29528-ddee-4504-9ac2-2cb3bac9e0cb tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:35.387521 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-68e29528-ddee-4504-9ac2-2cb3bac9e0cb tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:35.388319 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-68e29528-ddee-4504-9ac2-2cb3bac9e0cb tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:35.393124 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-68e29528-ddee-4504-9ac2-2cb3bac9e0cb tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:35.452695 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-68e29528-ddee-4504-9ac2-2cb3bac9e0cb tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9/ips" status: 200 len: 146 microversion: 2.1 time: 0.096308 Aug 17 08:39:35.460055 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 92/192] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 08:39:35 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9/ips => generated 146 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:39:35.526484 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-543e28d6-d16b-449a-84e8-a29ac3d9426a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:35.535785 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-543e28d6-d16b-449a-84e8-a29ac3d9426a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1522 microversion: 2.1 time: 0.417570 Aug 17 08:39:35.536897 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 101/193] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:35 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:35.926889 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-4eb1aa26-4ad4-435d-bd95-b47cec6aa404 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Action: 'create', calling method: .version_select at 0x7f3f856443a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1137111819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjq1HjleAfUqjVMtSCLOJx4QxFppLLkXsJ3AUnquSsv9oyNc3FmxbMZQmv+LLp59Iy3Xetz5UP8uUe2fhlojV8QO/qbfVE5yyO3xT0oVDWWa+cEQjhYSeB/NZdE1Kebeg=="}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:39:35.951910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-4eb1aa26-4ad4-435d-bd95-b47cec6aa404 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Getting quotas for project 08ccc5a670c049eda6e6f5b97b73ebec. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:39:35.959389 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-4eb1aa26-4ad4-435d-bd95-b47cec6aa404 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Getting quotas for user 73ea9b3af8884377888513b608669afa and project 08ccc5a670c049eda6e6f5b97b73ebec. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:39:36.016698 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-4eb1aa26-4ad4-435d-bd95-b47cec6aa404 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.525312 Aug 17 08:39:36.018519 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 93/194] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 08:39:35 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:39:36.565648 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5946afaf-5ddb-4445-abbb-fd36bb644ea0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:36.566409 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-5946afaf-5ddb-4445-abbb-fd36bb644ea0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:36.577585 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5946afaf-5ddb-4445-abbb-fd36bb644ea0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:36.583321 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5946afaf-5ddb-4445-abbb-fd36bb644ea0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:36.585610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5946afaf-5ddb-4445-abbb-fd36bb644ea0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:36.588741 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5946afaf-5ddb-4445-abbb-fd36bb644ea0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:36.589439 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5946afaf-5ddb-4445-abbb-fd36bb644ea0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:36.593999 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5946afaf-5ddb-4445-abbb-fd36bb644ea0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:36.860668 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-5946afaf-5ddb-4445-abbb-fd36bb644ea0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:36.877560 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-5946afaf-5ddb-4445-abbb-fd36bb644ea0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1522 microversion: 2.1 time: 0.318245 Aug 17 08:39:36.885079 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 102/195] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:36 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:36.999732 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f3453939-574f-4ac0-b626-252a2b80245d tempest-VolumesTestJSON-1690999997 tempest-VolumesTestJSON-1690999997-project] Calling method '.version_select at 0x7f3f85631ca0>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:37.082519 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f3453939-574f-4ac0-b626-252a2b80245d tempest-VolumesTestJSON-1690999997 tempest-VolumesTestJSON-1690999997-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/2f4ac854-7989-445a-be62-2df26c315982" status: 200 len: 350 microversion: 2.1 time: 0.086553 Aug 17 08:39:37.083229 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 94/196] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 08:39:36 2022] GET /compute/v2.1/os-volumes/2f4ac854-7989-445a-be62-2df26c315982 => generated 350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:39:37.096295 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-fb086db5-a8a6-4baf-ab7d-860e8cf3f5aa tempest-VolumesTestJSON-1690999997 tempest-VolumesTestJSON-1690999997-project] Calling method '.version_select at 0x7f3f85dd3dc0>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:37.184727 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-fb086db5-a8a6-4baf-ab7d-860e8cf3f5aa tempest-VolumesTestJSON-1690999997 tempest-VolumesTestJSON-1690999997-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.091600 Aug 17 08:39:37.185640 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 103/197] 10.222.0.15 () {58 vars in 1134 bytes} [Wed Aug 17 08:39:37 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:37.201540 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b60fe088-e907-416e-b74e-fcc17bb81dac tempest-VolumesTestJSON-1690999997 tempest-VolumesTestJSON-1690999997-project] Calling method '.version_select at 0x7f3f8559e700>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:37.312610 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b60fe088-e907-416e-b74e-fcc17bb81dac tempest-VolumesTestJSON-1690999997 tempest-VolumesTestJSON-1690999997-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.115984 Aug 17 08:39:37.318454 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 95/198] 10.222.0.15 () {58 vars in 1149 bytes} [Wed Aug 17 08:39:37 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:39:37.326757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2244590e-5bb4-421b-b05a-8852eeffa2c6 tempest-VolumesTestJSON-1690999997 tempest-VolumesTestJSON-1690999997-project] Calling method '.version_select at 0x7f3f85e494c0>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:37.419322 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2244590e-5bb4-421b-b05a-8852eeffa2c6 tempest-VolumesTestJSON-1690999997 tempest-VolumesTestJSON-1690999997-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.096371 Aug 17 08:39:37.419942 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 104/199] 10.222.0.15 () {58 vars in 1134 bytes} [Wed Aug 17 08:39:37 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:37.441848 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3d2463f9-4743-4885-bcda-ef0ad2098aea tempest-VolumesTestJSON-1690999997 tempest-VolumesTestJSON-1690999997-project] Calling method '.version_select at 0x7f3f8559eaf0>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:37.567040 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3d2463f9-4743-4885-bcda-ef0ad2098aea tempest-VolumesTestJSON-1690999997 tempest-VolumesTestJSON-1690999997-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.133369 Aug 17 08:39:37.567650 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 96/200] 10.222.0.15 () {58 vars in 1167 bytes} [Wed Aug 17 08:39:37 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:39:37.582935 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0154c89d-b4e9-4e7c-9f70-eb2a47236dd4 tempest-VolumesTestJSON-1690999997 tempest-VolumesTestJSON-1690999997-project] Calling method '.version_select at 0x7f3f85e42ee0>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:37.723304 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0154c89d-b4e9-4e7c-9f70-eb2a47236dd4 tempest-VolumesTestJSON-1690999997 tempest-VolumesTestJSON-1690999997-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.146087 Aug 17 08:39:37.732124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 105/201] 10.222.0.15 () {58 vars in 1170 bytes} [Wed Aug 17 08:39:37 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:39:37.738240 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2412e6c6-d595-4ab1-9c8e-f36e933fa2c9 tempest-VolumesTestJSON-1690999997 tempest-VolumesTestJSON-1690999997-project] Calling method '.version_select at 0x7f3f85631700>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:37.912377 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8395dacf-3dad-463d-9997-13b1fc086034 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:37.914866 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8395dacf-3dad-463d-9997-13b1fc086034 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:37.929683 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8395dacf-3dad-463d-9997-13b1fc086034 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:37.930179 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8395dacf-3dad-463d-9997-13b1fc086034 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:37.930616 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8395dacf-3dad-463d-9997-13b1fc086034 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:37.931316 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8395dacf-3dad-463d-9997-13b1fc086034 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:37.935683 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8395dacf-3dad-463d-9997-13b1fc086034 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:37.936346 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8395dacf-3dad-463d-9997-13b1fc086034 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:37.941778 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2412e6c6-d595-4ab1-9c8e-f36e933fa2c9 tempest-VolumesTestJSON-1690999997 tempest-VolumesTestJSON-1690999997-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.207127 Aug 17 08:39:37.942417 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 97/202] 10.222.0.15 () {58 vars in 1155 bytes} [Wed Aug 17 08:39:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:37.958686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e61562cf-f804-4e43-b566-75007811f766 tempest-VolumesTestJSON-1690999997 tempest-VolumesTestJSON-1690999997-project] Calling method '.version_select at 0x7f3f85631b80>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:38.245616 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e61562cf-f804-4e43-b566-75007811f766 tempest-VolumesTestJSON-1690999997 tempest-VolumesTestJSON-1690999997-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.294028 Aug 17 08:39:38.246210 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 98/203] 10.222.0.15 () {58 vars in 1188 bytes} [Wed Aug 17 08:39:37 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:39:38.253822 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-52c8792a-308b-445d-80ad-ea50a7f5acee tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85876e99-fe2d-4eae-bef3-3376c95acbe7"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:39:38.258257 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-52c8792a-308b-445d-80ad-ea50a7f5acee tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:38.271582 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-52c8792a-308b-445d-80ad-ea50a7f5acee tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:38.273090 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-52c8792a-308b-445d-80ad-ea50a7f5acee tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:38.276671 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-52c8792a-308b-445d-80ad-ea50a7f5acee tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:38.277929 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-52c8792a-308b-445d-80ad-ea50a7f5acee tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:38.279304 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-52c8792a-308b-445d-80ad-ea50a7f5acee tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:38.280308 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-52c8792a-308b-445d-80ad-ea50a7f5acee tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:38.538743 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8395dacf-3dad-463d-9997-13b1fc086034 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:38.553157 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8395dacf-3dad-463d-9997-13b1fc086034 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1522 microversion: 2.1 time: 0.650274 Aug 17 08:39:38.566735 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 106/204] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:37 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1522 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:39:38.571721 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a6fa6512-eb26-4b76-a575-3783bb078938 tempest-VolumesTestJSON-1690999997 tempest-VolumesTestJSON-1690999997-project] Calling method '.version_select at 0x7f3f85f72940>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:38.769429 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a6fa6512-eb26-4b76-a575-3783bb078938 tempest-VolumesTestJSON-1690999997 tempest-VolumesTestJSON-1690999997-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.201178 Aug 17 08:39:38.772144 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 107/205] 10.222.0.15 () {58 vars in 1155 bytes} [Wed Aug 17 08:39:38 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:38.923929 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-52c8792a-308b-445d-80ad-ea50a7f5acee tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "POST /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.674217 Aug 17 08:39:38.924733 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 99/206] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 08:39:38 2022] POST /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9/os-volume_attachments => generated 194 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:39:39.574636 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-40089912-50bf-411c-a30d-3a98cda22f42 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:39.580432 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-40089912-50bf-411c-a30d-3a98cda22f42 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:39.591065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-40089912-50bf-411c-a30d-3a98cda22f42 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:39.591897 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-40089912-50bf-411c-a30d-3a98cda22f42 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:39.593134 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-40089912-50bf-411c-a30d-3a98cda22f42 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:39.594572 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-40089912-50bf-411c-a30d-3a98cda22f42 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:39.595172 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-40089912-50bf-411c-a30d-3a98cda22f42 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:39.595804 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-40089912-50bf-411c-a30d-3a98cda22f42 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:39.935429 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-40089912-50bf-411c-a30d-3a98cda22f42 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:39.945859 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-40089912-50bf-411c-a30d-3a98cda22f42 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1522 microversion: 2.1 time: 0.375393 Aug 17 08:39:39.946854 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 108/207] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:39 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:40.983923 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-025a5951-46c3-41df-8af5-9c3d1042914e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:40.983923 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-025a5951-46c3-41df-8af5-9c3d1042914e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:40.983923 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-025a5951-46c3-41df-8af5-9c3d1042914e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:40.983923 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-025a5951-46c3-41df-8af5-9c3d1042914e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:40.985157 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-025a5951-46c3-41df-8af5-9c3d1042914e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:40.985157 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-025a5951-46c3-41df-8af5-9c3d1042914e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:40.985157 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-025a5951-46c3-41df-8af5-9c3d1042914e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:40.985157 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-025a5951-46c3-41df-8af5-9c3d1042914e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:41.182548 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-025a5951-46c3-41df-8af5-9c3d1042914e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:41.192811 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-025a5951-46c3-41df-8af5-9c3d1042914e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1522 microversion: 2.1 time: 0.224441 Aug 17 08:39:41.193526 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 100/208] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:40 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:42.213777 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-100cd60e-91bd-4a81-becc-34a83b2d295c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:42.214368 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-100cd60e-91bd-4a81-becc-34a83b2d295c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:42.222245 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-100cd60e-91bd-4a81-becc-34a83b2d295c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:42.223011 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-100cd60e-91bd-4a81-becc-34a83b2d295c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:42.223439 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-100cd60e-91bd-4a81-becc-34a83b2d295c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:42.224221 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-100cd60e-91bd-4a81-becc-34a83b2d295c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:42.224721 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-100cd60e-91bd-4a81-becc-34a83b2d295c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:42.225141 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-100cd60e-91bd-4a81-becc-34a83b2d295c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:42.399347 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-100cd60e-91bd-4a81-becc-34a83b2d295c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:42.407050 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-100cd60e-91bd-4a81-becc-34a83b2d295c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1522 microversion: 2.1 time: 0.197081 Aug 17 08:39:42.407741 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 109/209] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:42 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:43.428560 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-fc0ecf25-f74a-4ecc-893e-bd024a52f2cf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:43.429159 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-fc0ecf25-f74a-4ecc-893e-bd024a52f2cf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:43.440804 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fc0ecf25-f74a-4ecc-893e-bd024a52f2cf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:43.441561 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fc0ecf25-f74a-4ecc-893e-bd024a52f2cf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:43.443965 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fc0ecf25-f74a-4ecc-893e-bd024a52f2cf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:43.445205 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fc0ecf25-f74a-4ecc-893e-bd024a52f2cf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:43.446152 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fc0ecf25-f74a-4ecc-893e-bd024a52f2cf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:43.447532 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fc0ecf25-f74a-4ecc-893e-bd024a52f2cf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:43.844289 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-fc0ecf25-f74a-4ecc-893e-bd024a52f2cf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:43.876673 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-fc0ecf25-f74a-4ecc-893e-bd024a52f2cf tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1522 microversion: 2.1 time: 0.452147 Aug 17 08:39:43.883278 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 101/210] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:43 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1522 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:44.902694 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7634e72e-c7aa-45b0-98a6-5a278aeed875 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:44.903518 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7634e72e-c7aa-45b0-98a6-5a278aeed875 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:44.916202 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7634e72e-c7aa-45b0-98a6-5a278aeed875 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:44.918065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7634e72e-c7aa-45b0-98a6-5a278aeed875 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:44.918696 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7634e72e-c7aa-45b0-98a6-5a278aeed875 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:44.920133 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7634e72e-c7aa-45b0-98a6-5a278aeed875 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:44.922842 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7634e72e-c7aa-45b0-98a6-5a278aeed875 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:44.923400 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7634e72e-c7aa-45b0-98a6-5a278aeed875 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:45.195553 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-7634e72e-c7aa-45b0-98a6-5a278aeed875 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:45.205390 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-7634e72e-c7aa-45b0-98a6-5a278aeed875 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1522 microversion: 2.1 time: 0.306981 Aug 17 08:39:45.226206 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 110/211] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:44 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:46.231164 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b1a4b3fe-2d1b-4d77-b2ae-9d1e93cf5d4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:46.244387 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b1a4b3fe-2d1b-4d77-b2ae-9d1e93cf5d4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:46.267112 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=4 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:46.320905 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b1a4b3fe-2d1b-4d77-b2ae-9d1e93cf5d4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:46.321937 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b1a4b3fe-2d1b-4d77-b2ae-9d1e93cf5d4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:46.322739 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b1a4b3fe-2d1b-4d77-b2ae-9d1e93cf5d4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:46.337657 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b1a4b3fe-2d1b-4d77-b2ae-9d1e93cf5d4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:46.338528 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b1a4b3fe-2d1b-4d77-b2ae-9d1e93cf5d4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:46.340518 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b1a4b3fe-2d1b-4d77-b2ae-9d1e93cf5d4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:46.767812 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b1a4b3fe-2d1b-4d77-b2ae-9d1e93cf5d4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:46.780183 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b1a4b3fe-2d1b-4d77-b2ae-9d1e93cf5d4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1522 microversion: 2.1 time: 0.552671 Aug 17 08:39:46.800432 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 102/212] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:46 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1522 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:47.086725 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0c76031d-b1fc-418f-ad8c-39c204676f53 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:39:47.106892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0c76031d-b1fc-418f-ad8c-39c204676f53 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:47.108479 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0c76031d-b1fc-418f-ad8c-39c204676f53 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:47.109832 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0c76031d-b1fc-418f-ad8c-39c204676f53 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:47.268533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0c76031d-b1fc-418f-ad8c-39c204676f53 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Going to try to stop instance {{(pid=127297) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 17 08:39:47.479914 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0c76031d-b1fc-418f-ad8c-39c204676f53 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "POST /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9/action" status: 202 len: 0 microversion: 2.1 time: 0.398833 Aug 17 08:39:47.481268 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 111/213] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 08:39:47 2022] POST /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:39:47.489546 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-47255aeb-c82b-4405-a917-522af2cb9f58 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:47.490797 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-47255aeb-c82b-4405-a917-522af2cb9f58 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:47.501840 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-47255aeb-c82b-4405-a917-522af2cb9f58 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:47.502342 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-47255aeb-c82b-4405-a917-522af2cb9f58 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:47.504713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-47255aeb-c82b-4405-a917-522af2cb9f58 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:47.507692 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-47255aeb-c82b-4405-a917-522af2cb9f58 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:47.525303 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-47255aeb-c82b-4405-a917-522af2cb9f58 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:47.530556 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-47255aeb-c82b-4405-a917-522af2cb9f58 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:47.823834 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0f8c4bdf-3a41-41f9-9ab7-2349eaa9728e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:47.824527 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0f8c4bdf-3a41-41f9-9ab7-2349eaa9728e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:47.827579 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-47255aeb-c82b-4405-a917-522af2cb9f58 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:47.839053 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0f8c4bdf-3a41-41f9-9ab7-2349eaa9728e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:47.839531 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0f8c4bdf-3a41-41f9-9ab7-2349eaa9728e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:47.840009 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0f8c4bdf-3a41-41f9-9ab7-2349eaa9728e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:47.840719 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0f8c4bdf-3a41-41f9-9ab7-2349eaa9728e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:47.841022 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-47255aeb-c82b-4405-a917-522af2cb9f58 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1723 microversion: 2.1 time: 0.355639 Aug 17 08:39:47.841178 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0f8c4bdf-3a41-41f9-9ab7-2349eaa9728e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:47.841595 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0f8c4bdf-3a41-41f9-9ab7-2349eaa9728e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:47.842793 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 103/214] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:47 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1723 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:48.165565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0f8c4bdf-3a41-41f9-9ab7-2349eaa9728e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:48.187525 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0f8c4bdf-3a41-41f9-9ab7-2349eaa9728e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1522 microversion: 2.1 time: 0.367738 Aug 17 08:39:48.188989 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 112/215] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:47 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:48.865052 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f6fa895d-b792-43d2-a11e-6c9be8e59bf5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:48.867184 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f6fa895d-b792-43d2-a11e-6c9be8e59bf5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:48.879104 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f6fa895d-b792-43d2-a11e-6c9be8e59bf5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:48.880810 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f6fa895d-b792-43d2-a11e-6c9be8e59bf5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:48.881411 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f6fa895d-b792-43d2-a11e-6c9be8e59bf5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:48.882273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f6fa895d-b792-43d2-a11e-6c9be8e59bf5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:48.882861 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f6fa895d-b792-43d2-a11e-6c9be8e59bf5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:48.886135 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f6fa895d-b792-43d2-a11e-6c9be8e59bf5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:49.085350 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f6fa895d-b792-43d2-a11e-6c9be8e59bf5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:49.091301 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:49.096643 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f6fa895d-b792-43d2-a11e-6c9be8e59bf5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1723 microversion: 2.1 time: 0.234304 Aug 17 08:39:49.097217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 104/216] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:48 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:49.214029 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-11871ba1-e4a8-4ba0-bbd3-e0f5b1fc978a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:49.214619 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-11871ba1-e4a8-4ba0-bbd3-e0f5b1fc978a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:49.222290 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-11871ba1-e4a8-4ba0-bbd3-e0f5b1fc978a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:49.222794 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-11871ba1-e4a8-4ba0-bbd3-e0f5b1fc978a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:49.223314 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-11871ba1-e4a8-4ba0-bbd3-e0f5b1fc978a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:49.224021 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-11871ba1-e4a8-4ba0-bbd3-e0f5b1fc978a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:49.224467 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-11871ba1-e4a8-4ba0-bbd3-e0f5b1fc978a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:49.224948 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-11871ba1-e4a8-4ba0-bbd3-e0f5b1fc978a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:49.405816 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-11871ba1-e4a8-4ba0-bbd3-e0f5b1fc978a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:49.413704 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-11871ba1-e4a8-4ba0-bbd3-e0f5b1fc978a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1522 microversion: 2.1 time: 0.203549 Aug 17 08:39:49.414277 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 113/217] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:49 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:50.117412 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e27e2354-780d-457a-883e-0d2d008c19a6 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:50.118028 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e27e2354-780d-457a-883e-0d2d008c19a6 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:50.125953 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e27e2354-780d-457a-883e-0d2d008c19a6 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:50.126668 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e27e2354-780d-457a-883e-0d2d008c19a6 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:50.127274 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e27e2354-780d-457a-883e-0d2d008c19a6 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:50.128379 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e27e2354-780d-457a-883e-0d2d008c19a6 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:50.129036 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e27e2354-780d-457a-883e-0d2d008c19a6 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:50.129616 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e27e2354-780d-457a-883e-0d2d008c19a6 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:50.297551 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e27e2354-780d-457a-883e-0d2d008c19a6 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:50.308149 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e27e2354-780d-457a-883e-0d2d008c19a6 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1723 microversion: 2.1 time: 0.194442 Aug 17 08:39:50.308817 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 105/218] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:50 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:50.434068 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-30ca9d7b-f30c-45f3-8c58-d2e5eba3fba2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:50.434669 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-30ca9d7b-f30c-45f3-8c58-d2e5eba3fba2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:50.455750 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-30ca9d7b-f30c-45f3-8c58-d2e5eba3fba2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:50.456315 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-30ca9d7b-f30c-45f3-8c58-d2e5eba3fba2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:50.456757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-30ca9d7b-f30c-45f3-8c58-d2e5eba3fba2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:50.457742 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-30ca9d7b-f30c-45f3-8c58-d2e5eba3fba2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:50.458179 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-30ca9d7b-f30c-45f3-8c58-d2e5eba3fba2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:50.458596 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-30ca9d7b-f30c-45f3-8c58-d2e5eba3fba2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:50.648054 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-30ca9d7b-f30c-45f3-8c58-d2e5eba3fba2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:50.657429 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-30ca9d7b-f30c-45f3-8c58-d2e5eba3fba2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1522 microversion: 2.1 time: 0.227036 Aug 17 08:39:50.659193 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 114/219] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:50 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:51.331521 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3eef2843-c286-49af-b9d6-daf959f31dd5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:51.332474 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3eef2843-c286-49af-b9d6-daf959f31dd5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:51.339155 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3eef2843-c286-49af-b9d6-daf959f31dd5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:51.340210 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3eef2843-c286-49af-b9d6-daf959f31dd5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:51.340645 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3eef2843-c286-49af-b9d6-daf959f31dd5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:51.341333 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3eef2843-c286-49af-b9d6-daf959f31dd5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:51.341777 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3eef2843-c286-49af-b9d6-daf959f31dd5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:51.342188 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3eef2843-c286-49af-b9d6-daf959f31dd5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:51.506985 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-3eef2843-c286-49af-b9d6-daf959f31dd5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:51.517738 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3eef2843-c286-49af-b9d6-daf959f31dd5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1723 microversion: 2.1 time: 0.191308 Aug 17 08:39:51.518402 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 106/220] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:51 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:51.681117 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1c10eb97-af6a-4f84-9e91-1911ba11a504 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:51.681712 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1c10eb97-af6a-4f84-9e91-1911ba11a504 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:51.689426 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1c10eb97-af6a-4f84-9e91-1911ba11a504 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:51.690189 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1c10eb97-af6a-4f84-9e91-1911ba11a504 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:51.690843 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1c10eb97-af6a-4f84-9e91-1911ba11a504 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:51.691707 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1c10eb97-af6a-4f84-9e91-1911ba11a504 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:51.692382 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1c10eb97-af6a-4f84-9e91-1911ba11a504 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:51.692803 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1c10eb97-af6a-4f84-9e91-1911ba11a504 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:51.857029 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-1c10eb97-af6a-4f84-9e91-1911ba11a504 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:51.865169 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1c10eb97-af6a-4f84-9e91-1911ba11a504 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1522 microversion: 2.1 time: 0.187910 Aug 17 08:39:51.865692 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 115/221] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:51 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:51.962328 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1b6a2ef7-d845-4f1d-84a0-3ed61ccb7081 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Action: 'create', calling method: .version_select at 0x7f3f85552940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1867202716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/9v0B+sSDu/iLLr/Sxx3SaZFCrNfwywKE7vlQn04PK+Nn2rrIaM9S8iaA5xBZlCMz/vaXJ49XOiSzy2WvmmadtTUL6JAfvp2z4T2asIG8GMAxstgyOHxawoxQ8zu6Q+Q=="}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:39:51.972551 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:51.981570 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-1b6a2ef7-d845-4f1d-84a0-3ed61ccb7081 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Getting quotas for project 8c0e70db84d64777af111825ff71df8c. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:39:51.986082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-1b6a2ef7-d845-4f1d-84a0-3ed61ccb7081 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Getting quotas for user 954309a32da947518f8ad201dfa51ccb and project 8c0e70db84d64777af111825ff71df8c. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:39:52.011382 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1b6a2ef7-d845-4f1d-84a0-3ed61ccb7081 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052836 Aug 17 08:39:52.015173 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 107/222] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 08:39:51 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:39:52.167423 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7a9765d4-976a-42d4-bd90-11f90bb4cf87 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1613730376", "imageRef": "a0d29e81-0f04-4170-87ec-5b430b6bdb6e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1867202716", "networks": [{"uuid": "be6dd4db-ac5a-45a7-85cf-79169f1ab429"}]}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:39:52.234547 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.network.neutron [None req-7a9765d4-976a-42d4-bd90-11f90bb4cf87 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] validate_networks() for [('be6dd4db-ac5a-45a7-85cf-79169f1ab429', None, None, None, None, None)] {{(pid=127297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 08:39:52.540893 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-05e0f9f7-f00a-4f42-a5ba-4e9634351e13 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:52.542258 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-05e0f9f7-f00a-4f42-a5ba-4e9634351e13 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:52.554530 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-05e0f9f7-f00a-4f42-a5ba-4e9634351e13 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:52.555921 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-05e0f9f7-f00a-4f42-a5ba-4e9634351e13 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:52.556580 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-05e0f9f7-f00a-4f42-a5ba-4e9634351e13 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:52.557624 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-05e0f9f7-f00a-4f42-a5ba-4e9634351e13 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:52.558332 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-05e0f9f7-f00a-4f42-a5ba-4e9634351e13 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:52.558953 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-05e0f9f7-f00a-4f42-a5ba-4e9634351e13 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:52.698635 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-7a9765d4-976a-42d4-bd90-11f90bb4cf87 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Flavor limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 08:39:52.699095 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-7a9765d4-976a-42d4-bd90-11f90bb4cf87 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Image limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 08:39:52.703676 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-7a9765d4-976a-42d4-bd90-11f90bb4cf87 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Flavor pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 08:39:52.704449 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-7a9765d4-976a-42d4-bd90-11f90bb4cf87 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Image pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 08:39:52.705360 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-7a9765d4-976a-42d4-bd90-11f90bb4cf87 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 08:39:52.716835 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7a9765d4-976a-42d4-bd90-11f90bb4cf87 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:52.717313 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7a9765d4-976a-42d4-bd90-11f90bb4cf87 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:52.717738 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7a9765d4-976a-42d4-bd90-11f90bb4cf87 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:52.719338 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7a9765d4-976a-42d4-bd90-11f90bb4cf87 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:52.720069 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7a9765d4-976a-42d4-bd90-11f90bb4cf87 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:52.720771 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7a9765d4-976a-42d4-bd90-11f90bb4cf87 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:52.740719 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-7a9765d4-976a-42d4-bd90-11f90bb4cf87 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Getting quotas for project 8c0e70db84d64777af111825ff71df8c. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:39:52.741617 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-05e0f9f7-f00a-4f42-a5ba-4e9634351e13 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:52.745433 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-7a9765d4-976a-42d4-bd90-11f90bb4cf87 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Getting quotas for user 954309a32da947518f8ad201dfa51ccb and project 8c0e70db84d64777af111825ff71df8c. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:39:52.749670 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-05e0f9f7-f00a-4f42-a5ba-4e9634351e13 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1723 microversion: 2.1 time: 0.214715 Aug 17 08:39:52.750634 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 108/223] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:52 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:52.758312 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7a9765d4-976a-42d4-bd90-11f90bb4cf87 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Going to run 1 instances... {{(pid=127297) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 08:39:52.760631 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7a9765d4-976a-42d4-bd90-11f90bb4cf87 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0d29e81-0f04-4170-87ec-5b430b6bdb6e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 08:39:52.809793 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-7a9765d4-976a-42d4-bd90-11f90bb4cf87 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646055 Aug 17 08:39:52.810444 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 116/224] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 08:39:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 08:39:52.820851 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-109e271d-6353-4c5a-813a-a7c131007e63 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:52.821449 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-109e271d-6353-4c5a-813a-a7c131007e63 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:52.879713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-109e271d-6353-4c5a-813a-a7c131007e63 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:52.888887 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-18baa672-7602-489f-8108-fc4869df7338 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:52.889736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-18baa672-7602-489f-8108-fc4869df7338 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:52.892653 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-109e271d-6353-4c5a-813a-a7c131007e63 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1259 microversion: 2.1 time: 0.075361 Aug 17 08:39:52.893417 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 109/225] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:52 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1259 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:52.898510 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-18baa672-7602-489f-8108-fc4869df7338 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:52.900756 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-18baa672-7602-489f-8108-fc4869df7338 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:52.901381 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-18baa672-7602-489f-8108-fc4869df7338 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:52.902475 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-18baa672-7602-489f-8108-fc4869df7338 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:52.903080 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-18baa672-7602-489f-8108-fc4869df7338 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:52.903757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-18baa672-7602-489f-8108-fc4869df7338 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:52.908703 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:53.049087 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-18baa672-7602-489f-8108-fc4869df7338 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:53.059219 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-18baa672-7602-489f-8108-fc4869df7338 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1522 microversion: 2.1 time: 0.174346 Aug 17 08:39:53.059925 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 117/226] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:52 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:39:53.770324 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b4e8fea8-ee5b-45e4-9527-c280292fa473 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:53.770925 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b4e8fea8-ee5b-45e4-9527-c280292fa473 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:53.779489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b4e8fea8-ee5b-45e4-9527-c280292fa473 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:53.780013 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b4e8fea8-ee5b-45e4-9527-c280292fa473 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:53.780448 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b4e8fea8-ee5b-45e4-9527-c280292fa473 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:53.781178 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b4e8fea8-ee5b-45e4-9527-c280292fa473 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:53.781629 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b4e8fea8-ee5b-45e4-9527-c280292fa473 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:53.782044 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b4e8fea8-ee5b-45e4-9527-c280292fa473 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:53.914260 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f59363b6-85e8-4e85-af16-ef2b91fc3394 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:53.914930 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f59363b6-85e8-4e85-af16-ef2b91fc3394 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:53.926227 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f59363b6-85e8-4e85-af16-ef2b91fc3394 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:53.926918 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f59363b6-85e8-4e85-af16-ef2b91fc3394 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:53.928021 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f59363b6-85e8-4e85-af16-ef2b91fc3394 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:53.928882 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f59363b6-85e8-4e85-af16-ef2b91fc3394 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:53.932640 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f59363b6-85e8-4e85-af16-ef2b91fc3394 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:53.936066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f59363b6-85e8-4e85-af16-ef2b91fc3394 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:53.994681 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b4e8fea8-ee5b-45e4-9527-c280292fa473 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:54.003698 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b4e8fea8-ee5b-45e4-9527-c280292fa473 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1723 microversion: 2.1 time: 0.237106 Aug 17 08:39:54.004277 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 110/227] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:53 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:54.049000 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-f59363b6-85e8-4e85-af16-ef2b91fc3394 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:54.060749 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f59363b6-85e8-4e85-af16-ef2b91fc3394 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1255 microversion: 2.1 time: 0.151437 Aug 17 08:39:54.061326 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 118/228] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:53 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1255 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:54.080384 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8cb300ce-275f-4302-816b-df76667c3a98 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:54.081269 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8cb300ce-275f-4302-816b-df76667c3a98 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:54.088756 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8cb300ce-275f-4302-816b-df76667c3a98 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:54.089494 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8cb300ce-275f-4302-816b-df76667c3a98 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:54.090105 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8cb300ce-275f-4302-816b-df76667c3a98 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:54.090971 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8cb300ce-275f-4302-816b-df76667c3a98 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:54.091614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8cb300ce-275f-4302-816b-df76667c3a98 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:54.092299 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8cb300ce-275f-4302-816b-df76667c3a98 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:54.288992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8cb300ce-275f-4302-816b-df76667c3a98 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:54.296442 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8cb300ce-275f-4302-816b-df76667c3a98 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1502 microversion: 2.1 time: 0.220450 Aug 17 08:39:54.297009 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 111/229] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:54 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1502 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:54.319397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e66b6f9a-f33c-4d1d-b12a-bdc99d5cba4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5bb4a3f7-9598-4c2f-9056-edf5cd9d1e48"}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:39:54.322097 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e66b6f9a-f33c-4d1d-b12a-bdc99d5cba4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:54.329548 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e66b6f9a-f33c-4d1d-b12a-bdc99d5cba4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:54.329988 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e66b6f9a-f33c-4d1d-b12a-bdc99d5cba4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:54.330417 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e66b6f9a-f33c-4d1d-b12a-bdc99d5cba4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:54.331110 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e66b6f9a-f33c-4d1d-b12a-bdc99d5cba4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:54.331571 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e66b6f9a-f33c-4d1d-b12a-bdc99d5cba4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:54.332262 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e66b6f9a-f33c-4d1d-b12a-bdc99d5cba4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:54.355214 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-e66b6f9a-f33c-4d1d-b12a-bdc99d5cba4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] HTTP exception thrown: Cannot 'attach_volume' instance fcce3821-0099-45bc-9283-1ad5632080ce while it is in vm_state rescued Aug 17 08:39:54.356921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e66b6f9a-f33c-4d1d-b12a-bdc99d5cba4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Request method failure captured: Aug 17 08:39:54.356921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: POST /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce/os-volume_attachments HTTP/1.1 Aug 17 08:39:54.356921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:39:54.356921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:39:54.356921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:39:54.356921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 74 Aug 17 08:39:54.356921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:39:54.356921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:39:54.356921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:39:54.356921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:39:54.356921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_Kji6Z6va2Uun3O7PfuwZB78DrFVBWntRNdu90xpb_V8I8QwVJ2kvC1hN3MJ79pVctymf4qsZ66__L6U-Av0K3yOggyHXxU1_rw06E-jph23OY_HLUrhK8ayFUMvsxgiYt2c7Y4q-1Au0PC8GFHJjVF0sKN8b-BkvnKkF76FNyXvPfQ Aug 17 08:39:54.356921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:39:54.356921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:39:54.356921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:39:54.356921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:39:54.356921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:39:54.356921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:39:54.356921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: 2f3596b4a1404d3db340943fbd63567d Aug 17 08:39:54.356921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-197889665 Aug 17 08:39:54.356921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:39:54.356921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:39:54.358597 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2f3596b4a1404d3db340943fbd63567d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2f3596b4a1404d3db340943fbd63567d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2f3596b4a1404d3db340943fbd63567d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2f3596b4a1404d3db340943fbd63567d", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:39:54.358597 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-ServerRescueNegativeTestJSON-197889665 Aug 17 08:39:54.358597 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 2f3596b4a1404d3db340943fbd63567d Aug 17 08:39:54.358597 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-197889665 Aug 17 08:39:54.358597 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-ServerRescueNegativeTestJSON-197889665-project Aug 17 08:39:54.358597 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:39:54.358597 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:39:54.358597 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: f051f99404fc4e0593553ae95e1f90d5 Aug 17 08:39:54.358597 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-ServerRescueNegativeTestJSON-197889665-project Aug 17 08:39:54.358597 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Aug 17 08:39:54.358597 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {"volumeAttachment": {"volumeId": "5bb4a3f7-9598-4c2f-9056-edf5cd9d1e48"}} Aug 17 08:39:54.358597 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: > Aug 17 08:39:54.360212 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Cannot 'attach_volume' instance fcce3821-0099-45bc-9283-1ad5632080ce while it is in vm_state rescued Aug 17 08:39:54.360212 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'server_id': 'fcce3821-0099-45bc-9283-1ad5632080ce', 'body': {'volumeAttachment': {'volumeId': '5bb4a3f7-9598-4c2f-9056-edf5cd9d1e48'}}} Aug 17 08:39:54.360212 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:39:54.360212 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:39:54.360212 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 08:39:54.360212 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 08:39:54.360212 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 08:39:54.360212 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 08:39:54.360212 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 17 08:39:54.360212 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 17 08:39:54.360212 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fcce3821-0099-45bc-9283-1ad5632080ce in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 17 08:39:54.360212 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:54.360212 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:39:54.360212 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:54.360212 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:39:54.360212 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:39:54.360212 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:39:54.360212 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:39:54.360212 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:39:54.363782 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:39:54.363782 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:39:54.363782 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 08:39:54.363782 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 08:39:54.363782 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 08:39:54.363782 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 08:39:54.363782 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 08:39:54.363782 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 08:39:54.363782 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 17 08:39:54.363782 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 17 08:39:54.363782 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 17 08:39:54.363782 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 17 08:39:54.363782 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance fcce3821-0099-45bc-9283-1ad5632080ce while it is in vm_state rescued Aug 17 08:39:54.363782 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:54.363782 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:39:54.363782 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:54.363782 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:39:54.363782 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:39:54.363782 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:39:54.365194 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:39:54.365194 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:39:54.365194 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance fcce3821-0099-45bc-9283-1ad5632080ce while it is in vm_state rescued Aug 17 08:39:54.365194 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:39:54.365194 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e66b6f9a-f33c-4d1d-b12a-bdc99d5cba4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Returning 409 to user: Cannot 'attach_volume' instance fcce3821-0099-45bc-9283-1ad5632080ce while it is in vm_state rescued {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:39:54.365194 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e66b6f9a-f33c-4d1d-b12a-bdc99d5cba4a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "POST /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044911 Aug 17 08:39:54.365194 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 119/230] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 08:39:54 2022] POST /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 17 08:39:54.369456 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-596c53a5-5ba5-40f6-8bad-aa30d1674f2f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:39:54.369983 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-596c53a5-5ba5-40f6-8bad-aa30d1674f2f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:54.376490 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-596c53a5-5ba5-40f6-8bad-aa30d1674f2f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:54.376965 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-596c53a5-5ba5-40f6-8bad-aa30d1674f2f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:54.377393 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-596c53a5-5ba5-40f6-8bad-aa30d1674f2f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:54.378061 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-596c53a5-5ba5-40f6-8bad-aa30d1674f2f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:54.378507 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-596c53a5-5ba5-40f6-8bad-aa30d1674f2f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:54.378920 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-596c53a5-5ba5-40f6-8bad-aa30d1674f2f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:54.452760 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-596c53a5-5ba5-40f6-8bad-aa30d1674f2f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "POST /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce/action" status: 202 len: 0 microversion: 2.1 time: 0.088497 Aug 17 08:39:54.453541 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 112/231] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 08:39:54 2022] POST /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:39:54.462160 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-58f35149-f58e-439b-a2e8-d85332ffee0c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:54.463363 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-58f35149-f58e-439b-a2e8-d85332ffee0c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:54.469585 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58f35149-f58e-439b-a2e8-d85332ffee0c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:54.470066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58f35149-f58e-439b-a2e8-d85332ffee0c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:54.470501 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58f35149-f58e-439b-a2e8-d85332ffee0c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:54.471193 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58f35149-f58e-439b-a2e8-d85332ffee0c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:54.471672 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58f35149-f58e-439b-a2e8-d85332ffee0c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:54.472097 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58f35149-f58e-439b-a2e8-d85332ffee0c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:54.719388 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-58f35149-f58e-439b-a2e8-d85332ffee0c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:54.731250 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-58f35149-f58e-439b-a2e8-d85332ffee0c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1510 microversion: 2.1 time: 0.273205 Aug 17 08:39:54.731966 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 120/232] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:54 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1510 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:39:55.036945 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e5205dd4-ba5d-4a3e-a167-456885329ec8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:55.038418 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e5205dd4-ba5d-4a3e-a167-456885329ec8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:55.050831 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e5205dd4-ba5d-4a3e-a167-456885329ec8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:55.051329 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e5205dd4-ba5d-4a3e-a167-456885329ec8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:55.053045 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e5205dd4-ba5d-4a3e-a167-456885329ec8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:55.053803 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e5205dd4-ba5d-4a3e-a167-456885329ec8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:55.056183 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e5205dd4-ba5d-4a3e-a167-456885329ec8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:55.059760 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e5205dd4-ba5d-4a3e-a167-456885329ec8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:55.082699 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-48bed108-90ec-4253-b2af-337dccee9ef3 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:55.083304 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-48bed108-90ec-4253-b2af-337dccee9ef3 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:55.093035 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48bed108-90ec-4253-b2af-337dccee9ef3 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:55.093531 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48bed108-90ec-4253-b2af-337dccee9ef3 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:55.096927 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48bed108-90ec-4253-b2af-337dccee9ef3 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:55.097905 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48bed108-90ec-4253-b2af-337dccee9ef3 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:55.101290 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48bed108-90ec-4253-b2af-337dccee9ef3 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:55.101934 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48bed108-90ec-4253-b2af-337dccee9ef3 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:55.231489 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-48bed108-90ec-4253-b2af-337dccee9ef3 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:55.243373 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-48bed108-90ec-4253-b2af-337dccee9ef3 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1317 microversion: 2.1 time: 0.164621 Aug 17 08:39:55.248998 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 121/233] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:55 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:55.405168 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e5205dd4-ba5d-4a3e-a167-456885329ec8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:55.415710 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e5205dd4-ba5d-4a3e-a167-456885329ec8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1723 microversion: 2.1 time: 0.383872 Aug 17 08:39:55.416695 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 113/234] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:55 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1723 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:55.756406 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-35072aa0-b294-4963-80a1-e959d6cd0fd4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:55.757453 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-35072aa0-b294-4963-80a1-e959d6cd0fd4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:55.779060 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-35072aa0-b294-4963-80a1-e959d6cd0fd4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:55.779927 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-35072aa0-b294-4963-80a1-e959d6cd0fd4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:55.780695 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-35072aa0-b294-4963-80a1-e959d6cd0fd4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:55.781633 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-35072aa0-b294-4963-80a1-e959d6cd0fd4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:55.786613 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-35072aa0-b294-4963-80a1-e959d6cd0fd4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:55.787368 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-35072aa0-b294-4963-80a1-e959d6cd0fd4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:56.052671 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-35072aa0-b294-4963-80a1-e959d6cd0fd4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:56.063048 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-35072aa0-b294-4963-80a1-e959d6cd0fd4 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1510 microversion: 2.1 time: 0.308681 Aug 17 08:39:56.064020 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 122/235] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:55 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1510 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:56.271200 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-be09b7d6-3b6e-4c87-9d83-b8b03e36c0e0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:56.272886 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-be09b7d6-3b6e-4c87-9d83-b8b03e36c0e0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:56.294006 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-be09b7d6-3b6e-4c87-9d83-b8b03e36c0e0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:56.294646 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-be09b7d6-3b6e-4c87-9d83-b8b03e36c0e0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:56.295331 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-be09b7d6-3b6e-4c87-9d83-b8b03e36c0e0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:56.296921 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-be09b7d6-3b6e-4c87-9d83-b8b03e36c0e0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:56.297605 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-be09b7d6-3b6e-4c87-9d83-b8b03e36c0e0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:56.298185 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-be09b7d6-3b6e-4c87-9d83-b8b03e36c0e0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:56.434895 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-be09b7d6-3b6e-4c87-9d83-b8b03e36c0e0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:56.440394 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5f02f550-fbf2-48db-a3d5-792d125eba8b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:56.441556 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-5f02f550-fbf2-48db-a3d5-792d125eba8b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:56.443025 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-be09b7d6-3b6e-4c87-9d83-b8b03e36c0e0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1359 microversion: 2.1 time: 0.175776 Aug 17 08:39:56.443849 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 114/236] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:56 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:56.455752 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5f02f550-fbf2-48db-a3d5-792d125eba8b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:56.455752 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5f02f550-fbf2-48db-a3d5-792d125eba8b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:56.455752 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5f02f550-fbf2-48db-a3d5-792d125eba8b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:56.455752 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5f02f550-fbf2-48db-a3d5-792d125eba8b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:56.456120 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5f02f550-fbf2-48db-a3d5-792d125eba8b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:56.456120 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5f02f550-fbf2-48db-a3d5-792d125eba8b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:56.592724 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-5f02f550-fbf2-48db-a3d5-792d125eba8b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:56.601709 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-5f02f550-fbf2-48db-a3d5-792d125eba8b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1723 microversion: 2.1 time: 0.166991 Aug 17 08:39:56.602791 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 123/237] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:56 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:57.085423 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-844ea9e7-cd9f-45fc-9185-81e74558845e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:57.086200 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-844ea9e7-cd9f-45fc-9185-81e74558845e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:57.093668 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-844ea9e7-cd9f-45fc-9185-81e74558845e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:57.094433 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-844ea9e7-cd9f-45fc-9185-81e74558845e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:57.095045 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-844ea9e7-cd9f-45fc-9185-81e74558845e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:57.096086 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-844ea9e7-cd9f-45fc-9185-81e74558845e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:57.096736 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-844ea9e7-cd9f-45fc-9185-81e74558845e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:57.097419 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-844ea9e7-cd9f-45fc-9185-81e74558845e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:57.223582 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d95d831c-e3fe-4cd7-9e6c-cbf616d3ae66 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1101333411", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1137111819", "security_groups": [{"name": "tempest-secgroup-smoke-168264902"}], "networks": [{"uuid": "c7aec616-6c97-4152-9394-d883c8a75b37"}], "block_device_mapping_v2": [{"uuid": "80edc86e-590e-4a70-83be-0080a2beba92", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:39:57.256665 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:39:57.351699 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-844ea9e7-cd9f-45fc-9185-81e74558845e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:57.360231 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-844ea9e7-cd9f-45fc-9185-81e74558845e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1510 microversion: 2.1 time: 0.279714 Aug 17 08:39:57.361615 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 115/238] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:57 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1510 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:57.449893 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.network.neutron [None req-d95d831c-e3fe-4cd7-9e6c-cbf616d3ae66 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] validate_networks() for [('c7aec616-6c97-4152-9394-d883c8a75b37', None, None, None, None, None)] {{(pid=127297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 08:39:57.465478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-085a35d4-2bca-4010-b92a-fc5231bff971 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:57.466092 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-085a35d4-2bca-4010-b92a-fc5231bff971 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:57.472197 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-085a35d4-2bca-4010-b92a-fc5231bff971 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:57.472692 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-085a35d4-2bca-4010-b92a-fc5231bff971 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:57.473128 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-085a35d4-2bca-4010-b92a-fc5231bff971 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:57.473856 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-085a35d4-2bca-4010-b92a-fc5231bff971 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:57.474302 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-085a35d4-2bca-4010-b92a-fc5231bff971 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:57.474722 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-085a35d4-2bca-4010-b92a-fc5231bff971 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:57.640017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-085a35d4-2bca-4010-b92a-fc5231bff971 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:57.664262 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-085a35d4-2bca-4010-b92a-fc5231bff971 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1359 microversion: 2.1 time: 0.202781 Aug 17 08:39:57.665169 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 116/239] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:57 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:39:57.691855 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-53e8e99f-b691-45f1-9e4d-29ade38b27c4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:57.693666 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-53e8e99f-b691-45f1-9e4d-29ade38b27c4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:57.704327 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-53e8e99f-b691-45f1-9e4d-29ade38b27c4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:57.705161 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-53e8e99f-b691-45f1-9e4d-29ade38b27c4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:57.705783 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-53e8e99f-b691-45f1-9e4d-29ade38b27c4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:57.707115 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-53e8e99f-b691-45f1-9e4d-29ade38b27c4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:57.707798 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-53e8e99f-b691-45f1-9e4d-29ade38b27c4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:57.708409 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-53e8e99f-b691-45f1-9e4d-29ade38b27c4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:57.868316 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-53e8e99f-b691-45f1-9e4d-29ade38b27c4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:57.876545 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-53e8e99f-b691-45f1-9e4d-29ade38b27c4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1723 microversion: 2.1 time: 0.192625 Aug 17 08:39:57.877320 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 117/240] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:57 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:58.086895 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-d95d831c-e3fe-4cd7-9e6c-cbf616d3ae66 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Flavor limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 08:39:58.087348 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-d95d831c-e3fe-4cd7-9e6c-cbf616d3ae66 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Image limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 08:39:58.087844 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-d95d831c-e3fe-4cd7-9e6c-cbf616d3ae66 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Flavor pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 08:39:58.088517 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-d95d831c-e3fe-4cd7-9e6c-cbf616d3ae66 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Image pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 08:39:58.088927 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-d95d831c-e3fe-4cd7-9e6c-cbf616d3ae66 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 08:39:58.098314 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d95d831c-e3fe-4cd7-9e6c-cbf616d3ae66 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:58.098796 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d95d831c-e3fe-4cd7-9e6c-cbf616d3ae66 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:58.099227 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d95d831c-e3fe-4cd7-9e6c-cbf616d3ae66 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:58.099979 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d95d831c-e3fe-4cd7-9e6c-cbf616d3ae66 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:58.100427 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d95d831c-e3fe-4cd7-9e6c-cbf616d3ae66 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:58.100845 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d95d831c-e3fe-4cd7-9e6c-cbf616d3ae66 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:58.117159 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-d95d831c-e3fe-4cd7-9e6c-cbf616d3ae66 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Getting quotas for project 08ccc5a670c049eda6e6f5b97b73ebec. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:39:58.121031 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-d95d831c-e3fe-4cd7-9e6c-cbf616d3ae66 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Getting quotas for user 73ea9b3af8884377888513b608669afa and project 08ccc5a670c049eda6e6f5b97b73ebec. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:39:58.184794 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d95d831c-e3fe-4cd7-9e6c-cbf616d3ae66 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Going to run 1 instances... {{(pid=127297) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 08:39:58.186818 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d95d831c-e3fe-4cd7-9e6c-cbf616d3ae66 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='80edc86e-590e-4a70-83be-0080a2beba92',volume_size=None,volume_type=None)] {{(pid=127297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 08:39:58.366105 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d95d831c-e3fe-4cd7-9e6c-cbf616d3ae66 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.147907 Aug 17 08:39:58.366756 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 124/241] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 08:39:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 08:39:58.381837 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c166a7aa-e9c8-4789-ba37-477e071996ed tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:58.384250 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c166a7aa-e9c8-4789-ba37-477e071996ed tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:58.385518 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e81f6c2e-87e8-4ad8-b75c-92f820b913c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:58.386121 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e81f6c2e-87e8-4ad8-b75c-92f820b913c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:58.395227 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e81f6c2e-87e8-4ad8-b75c-92f820b913c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:58.395750 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e81f6c2e-87e8-4ad8-b75c-92f820b913c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:58.396181 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e81f6c2e-87e8-4ad8-b75c-92f820b913c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:58.396887 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e81f6c2e-87e8-4ad8-b75c-92f820b913c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:58.397355 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e81f6c2e-87e8-4ad8-b75c-92f820b913c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:58.397776 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e81f6c2e-87e8-4ad8-b75c-92f820b913c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:58.466884 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c166a7aa-e9c8-4789-ba37-477e071996ed tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:58.474379 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c166a7aa-e9c8-4789-ba37-477e071996ed tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1089 microversion: 2.1 time: 0.100472 Aug 17 08:39:58.475608 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 118/242] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:58 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1089 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:58.685667 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2cd8975e-e720-4f49-bdff-9a92dddff8b6 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:58.687806 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2cd8975e-e720-4f49-bdff-9a92dddff8b6 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:58.700447 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2cd8975e-e720-4f49-bdff-9a92dddff8b6 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:58.701905 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2cd8975e-e720-4f49-bdff-9a92dddff8b6 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:58.703213 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2cd8975e-e720-4f49-bdff-9a92dddff8b6 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:58.705748 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2cd8975e-e720-4f49-bdff-9a92dddff8b6 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:58.709337 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2cd8975e-e720-4f49-bdff-9a92dddff8b6 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:58.710223 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2cd8975e-e720-4f49-bdff-9a92dddff8b6 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:58.747748 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e81f6c2e-87e8-4ad8-b75c-92f820b913c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:58.777701 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e81f6c2e-87e8-4ad8-b75c-92f820b913c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1510 microversion: 2.1 time: 0.396268 Aug 17 08:39:58.783854 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 125/243] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:58 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1510 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:58.897416 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3637f47e-6544-4eb7-bd8e-8e3f3a7cc6c5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:58.898484 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3637f47e-6544-4eb7-bd8e-8e3f3a7cc6c5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:58.911334 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3637f47e-6544-4eb7-bd8e-8e3f3a7cc6c5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:58.913535 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3637f47e-6544-4eb7-bd8e-8e3f3a7cc6c5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:58.915198 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3637f47e-6544-4eb7-bd8e-8e3f3a7cc6c5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:58.919830 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3637f47e-6544-4eb7-bd8e-8e3f3a7cc6c5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:58.921550 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3637f47e-6544-4eb7-bd8e-8e3f3a7cc6c5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:58.924579 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3637f47e-6544-4eb7-bd8e-8e3f3a7cc6c5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:58.961890 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2cd8975e-e720-4f49-bdff-9a92dddff8b6 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:58.970467 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2cd8975e-e720-4f49-bdff-9a92dddff8b6 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1359 microversion: 2.1 time: 0.288517 Aug 17 08:39:58.986071 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 119/244] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:58 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1359 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:59.498606 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-314d5d12-4a4b-429a-8c25-3128190cbf1b tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:59.499608 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-314d5d12-4a4b-429a-8c25-3128190cbf1b tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:59.506382 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-314d5d12-4a4b-429a-8c25-3128190cbf1b tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:59.514785 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-314d5d12-4a4b-429a-8c25-3128190cbf1b tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:59.515707 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-314d5d12-4a4b-429a-8c25-3128190cbf1b tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:59.516770 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-314d5d12-4a4b-429a-8c25-3128190cbf1b tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:59.519262 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-314d5d12-4a4b-429a-8c25-3128190cbf1b tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:59.520058 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-314d5d12-4a4b-429a-8c25-3128190cbf1b tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:59.524326 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3637f47e-6544-4eb7-bd8e-8e3f3a7cc6c5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:59.540397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3637f47e-6544-4eb7-bd8e-8e3f3a7cc6c5 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1723 microversion: 2.1 time: 0.647257 Aug 17 08:39:59.540975 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 126/245] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:58 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1723 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:59.669740 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-314d5d12-4a4b-429a-8c25-3128190cbf1b tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:39:59.680360 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-314d5d12-4a4b-429a-8c25-3128190cbf1b tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1139 microversion: 2.1 time: 0.187076 Aug 17 08:39:59.681300 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 120/246] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:59 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1139 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:39:59.809204 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a8b94d66-6942-4b18-b11b-be63d9a59ba0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:59.809857 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a8b94d66-6942-4b18-b11b-be63d9a59ba0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:39:59.836096 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a8b94d66-6942-4b18-b11b-be63d9a59ba0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:59.836995 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a8b94d66-6942-4b18-b11b-be63d9a59ba0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:59.837420 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a8b94d66-6942-4b18-b11b-be63d9a59ba0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:59.838119 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a8b94d66-6942-4b18-b11b-be63d9a59ba0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:39:59.838560 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a8b94d66-6942-4b18-b11b-be63d9a59ba0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:39:59.838979 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a8b94d66-6942-4b18-b11b-be63d9a59ba0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:39:59.990649 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3b1d9ce0-cca2-42ac-9c31-7dd003ad45b0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:39:59.991246 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3b1d9ce0-cca2-42ac-9c31-7dd003ad45b0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:00.002604 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3b1d9ce0-cca2-42ac-9c31-7dd003ad45b0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:00.003616 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3b1d9ce0-cca2-42ac-9c31-7dd003ad45b0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:00.005431 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3b1d9ce0-cca2-42ac-9c31-7dd003ad45b0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:00.006800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3b1d9ce0-cca2-42ac-9c31-7dd003ad45b0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:00.008126 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3b1d9ce0-cca2-42ac-9c31-7dd003ad45b0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:00.008978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3b1d9ce0-cca2-42ac-9c31-7dd003ad45b0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:00.025621 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a8b94d66-6942-4b18-b11b-be63d9a59ba0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:00.035516 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a8b94d66-6942-4b18-b11b-be63d9a59ba0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1510 microversion: 2.1 time: 0.235814 Aug 17 08:40:00.049637 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 127/247] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:59 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1510 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:00.198411 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-3b1d9ce0-cca2-42ac-9c31-7dd003ad45b0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:00.208659 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3b1d9ce0-cca2-42ac-9c31-7dd003ad45b0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1359 microversion: 2.1 time: 0.221719 Aug 17 08:40:00.210941 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 121/248] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:39:59 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:00.565023 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-76d6e71c-b73f-41f9-b706-142da8ecd077 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:00.566324 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-76d6e71c-b73f-41f9-b706-142da8ecd077 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:00.576629 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-76d6e71c-b73f-41f9-b706-142da8ecd077 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:00.577287 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-76d6e71c-b73f-41f9-b706-142da8ecd077 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:00.579963 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-76d6e71c-b73f-41f9-b706-142da8ecd077 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:00.581045 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-76d6e71c-b73f-41f9-b706-142da8ecd077 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:00.581577 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-76d6e71c-b73f-41f9-b706-142da8ecd077 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:00.582389 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-76d6e71c-b73f-41f9-b706-142da8ecd077 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:00.700200 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-bc061be5-dd27-4fc6-8581-14f89b6ccdde tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:00.700817 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-bc061be5-dd27-4fc6-8581-14f89b6ccdde tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:00.707895 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc061be5-dd27-4fc6-8581-14f89b6ccdde tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:00.708458 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc061be5-dd27-4fc6-8581-14f89b6ccdde tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:00.709147 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc061be5-dd27-4fc6-8581-14f89b6ccdde tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:00.709943 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc061be5-dd27-4fc6-8581-14f89b6ccdde tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:00.710617 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc061be5-dd27-4fc6-8581-14f89b6ccdde tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:00.711285 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc061be5-dd27-4fc6-8581-14f89b6ccdde tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:00.756029 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-76d6e71c-b73f-41f9-b706-142da8ecd077 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:00.764695 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-76d6e71c-b73f-41f9-b706-142da8ecd077 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1723 microversion: 2.1 time: 0.205855 Aug 17 08:40:00.767865 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 128/249] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:00 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:00.788679 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-bc061be5-dd27-4fc6-8581-14f89b6ccdde tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:00.798732 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-bc061be5-dd27-4fc6-8581-14f89b6ccdde tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1139 microversion: 2.1 time: 0.102449 Aug 17 08:40:00.799406 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 122/250] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:00 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1139 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:40:01.058950 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-667146c9-1773-41ff-8ee2-c577c0485705 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:01.059586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-667146c9-1773-41ff-8ee2-c577c0485705 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:01.072806 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-667146c9-1773-41ff-8ee2-c577c0485705 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:01.073551 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-667146c9-1773-41ff-8ee2-c577c0485705 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:01.074312 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-667146c9-1773-41ff-8ee2-c577c0485705 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:01.075228 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-667146c9-1773-41ff-8ee2-c577c0485705 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:01.075715 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-667146c9-1773-41ff-8ee2-c577c0485705 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:01.076870 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-667146c9-1773-41ff-8ee2-c577c0485705 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:01.231067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6e088963-047e-453b-81e9-0d6fcfefd46d tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:01.231924 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6e088963-047e-453b-81e9-0d6fcfefd46d tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:01.243440 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6e088963-047e-453b-81e9-0d6fcfefd46d tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:01.246254 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6e088963-047e-453b-81e9-0d6fcfefd46d tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:01.246969 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6e088963-047e-453b-81e9-0d6fcfefd46d tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:01.249941 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6e088963-047e-453b-81e9-0d6fcfefd46d tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:01.254150 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6e088963-047e-453b-81e9-0d6fcfefd46d tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:01.255791 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6e088963-047e-453b-81e9-0d6fcfefd46d tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:01.302977 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:01.328364 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-667146c9-1773-41ff-8ee2-c577c0485705 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:01.355969 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-667146c9-1773-41ff-8ee2-c577c0485705 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1510 microversion: 2.1 time: 0.282027 Aug 17 08:40:01.357269 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 129/251] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:01 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1510 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:01.527431 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6e088963-047e-453b-81e9-0d6fcfefd46d tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:01.536095 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6e088963-047e-453b-81e9-0d6fcfefd46d tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1359 microversion: 2.1 time: 0.309653 Aug 17 08:40:01.536684 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 123/252] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:01 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1359 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:01.786214 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c213192f-77c6-4aa3-903d-12449931de7f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:01.787078 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c213192f-77c6-4aa3-903d-12449931de7f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:01.796916 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c213192f-77c6-4aa3-903d-12449931de7f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:01.797415 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c213192f-77c6-4aa3-903d-12449931de7f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:01.797854 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c213192f-77c6-4aa3-903d-12449931de7f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:01.801108 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c213192f-77c6-4aa3-903d-12449931de7f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:01.801689 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c213192f-77c6-4aa3-903d-12449931de7f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:01.802136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c213192f-77c6-4aa3-903d-12449931de7f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:01.818632 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5953efaa-63a1-4249-90eb-563cab9eb2df tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:01.819350 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5953efaa-63a1-4249-90eb-563cab9eb2df tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:01.836608 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5953efaa-63a1-4249-90eb-563cab9eb2df tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:01.837273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5953efaa-63a1-4249-90eb-563cab9eb2df tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:01.837716 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5953efaa-63a1-4249-90eb-563cab9eb2df tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:01.838426 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5953efaa-63a1-4249-90eb-563cab9eb2df tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:01.838880 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5953efaa-63a1-4249-90eb-563cab9eb2df tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:01.839304 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5953efaa-63a1-4249-90eb-563cab9eb2df tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:02.013662 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5953efaa-63a1-4249-90eb-563cab9eb2df tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:02.023247 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5953efaa-63a1-4249-90eb-563cab9eb2df tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1139 microversion: 2.1 time: 0.208474 Aug 17 08:40:02.025078 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 124/253] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:01 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1139 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:40:02.207282 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c213192f-77c6-4aa3-903d-12449931de7f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:02.221814 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c213192f-77c6-4aa3-903d-12449931de7f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1723 microversion: 2.1 time: 0.439615 Aug 17 08:40:02.223937 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 130/254] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:01 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1723 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:02.377682 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-29323b6c-606c-4677-b098-abd01a3a4b4d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:02.378483 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-29323b6c-606c-4677-b098-abd01a3a4b4d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:02.385274 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-29323b6c-606c-4677-b098-abd01a3a4b4d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:02.386106 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-29323b6c-606c-4677-b098-abd01a3a4b4d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:02.386706 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-29323b6c-606c-4677-b098-abd01a3a4b4d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:02.387576 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-29323b6c-606c-4677-b098-abd01a3a4b4d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:02.388174 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-29323b6c-606c-4677-b098-abd01a3a4b4d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:02.388744 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-29323b6c-606c-4677-b098-abd01a3a4b4d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:02.560637 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-10094478-ffba-424c-a8b3-9239abac4ead tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:02.561766 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-10094478-ffba-424c-a8b3-9239abac4ead tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:02.571503 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-10094478-ffba-424c-a8b3-9239abac4ead tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:02.572111 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-10094478-ffba-424c-a8b3-9239abac4ead tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:02.576042 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-10094478-ffba-424c-a8b3-9239abac4ead tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:02.576838 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-10094478-ffba-424c-a8b3-9239abac4ead tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:02.578196 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-10094478-ffba-424c-a8b3-9239abac4ead tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:02.578803 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-10094478-ffba-424c-a8b3-9239abac4ead tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:02.580838 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-29323b6c-606c-4677-b098-abd01a3a4b4d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:02.601901 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-29323b6c-606c-4677-b098-abd01a3a4b4d tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1510 microversion: 2.1 time: 0.227485 Aug 17 08:40:02.617636 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 125/255] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:02 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1510 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:02.737175 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-10094478-ffba-424c-a8b3-9239abac4ead tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:02.746481 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-10094478-ffba-424c-a8b3-9239abac4ead tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1359 microversion: 2.1 time: 0.190791 Aug 17 08:40:02.747132 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 131/256] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:02 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:03.044526 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-fe59bb03-2635-4aa8-9ad0-348fd70abc0c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:03.045144 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-fe59bb03-2635-4aa8-9ad0-348fd70abc0c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:03.051564 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fe59bb03-2635-4aa8-9ad0-348fd70abc0c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:03.052059 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fe59bb03-2635-4aa8-9ad0-348fd70abc0c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:03.052484 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fe59bb03-2635-4aa8-9ad0-348fd70abc0c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:03.053157 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fe59bb03-2635-4aa8-9ad0-348fd70abc0c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:03.053631 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fe59bb03-2635-4aa8-9ad0-348fd70abc0c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:03.054055 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fe59bb03-2635-4aa8-9ad0-348fd70abc0c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:03.116649 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-fe59bb03-2635-4aa8-9ad0-348fd70abc0c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:03.125317 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-fe59bb03-2635-4aa8-9ad0-348fd70abc0c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1139 microversion: 2.1 time: 0.084523 Aug 17 08:40:03.125892 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 126/257] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:03 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:40:03.244349 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-18a91194-53c4-467d-8ffb-0e4eb0521222 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:03.245610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-18a91194-53c4-467d-8ffb-0e4eb0521222 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:03.265913 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-18a91194-53c4-467d-8ffb-0e4eb0521222 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:03.266413 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-18a91194-53c4-467d-8ffb-0e4eb0521222 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:03.266848 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-18a91194-53c4-467d-8ffb-0e4eb0521222 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:03.267586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-18a91194-53c4-467d-8ffb-0e4eb0521222 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:03.268044 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-18a91194-53c4-467d-8ffb-0e4eb0521222 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:03.268466 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-18a91194-53c4-467d-8ffb-0e4eb0521222 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:03.437758 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-18a91194-53c4-467d-8ffb-0e4eb0521222 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:03.451232 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-18a91194-53c4-467d-8ffb-0e4eb0521222 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1723 microversion: 2.1 time: 0.210632 Aug 17 08:40:03.451848 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 132/258] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:03 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:40:03.627231 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-bff19110-f192-4581-8ac9-99fd0351f1c9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:03.628051 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-bff19110-f192-4581-8ac9-99fd0351f1c9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:03.635286 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bff19110-f192-4581-8ac9-99fd0351f1c9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:03.636189 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bff19110-f192-4581-8ac9-99fd0351f1c9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:03.637074 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bff19110-f192-4581-8ac9-99fd0351f1c9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:03.637961 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bff19110-f192-4581-8ac9-99fd0351f1c9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:03.638598 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bff19110-f192-4581-8ac9-99fd0351f1c9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:03.639469 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bff19110-f192-4581-8ac9-99fd0351f1c9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:03.671859 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a1ffb00d-5628-4f30-b071-4f6c68d63a7e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1609008392", "imageRef": "4467450c-a35c-42e3-af85-a13291b0b2aa", "flavorRef": "452", "networks": [{"uuid": "da2187ec-7cb4-4ddb-8853-c6d340e46221"}]}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:40:03.794680 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.network.neutron [None req-a1ffb00d-5628-4f30-b071-4f6c68d63a7e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] validate_networks() for [('da2187ec-7cb4-4ddb-8853-c6d340e46221', None, None, None, None, None)] {{(pid=127297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 08:40:03.894858 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-bff19110-f192-4581-8ac9-99fd0351f1c9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:03.902996 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-bff19110-f192-4581-8ac9-99fd0351f1c9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1510 microversion: 2.1 time: 0.280511 Aug 17 08:40:03.916806 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 127/259] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:03 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1510 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:03.924891 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ea804521-a5fd-4137-825e-f31914e39a98 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:03.925583 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ea804521-a5fd-4137-825e-f31914e39a98 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:03.931958 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ea804521-a5fd-4137-825e-f31914e39a98 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:03.932528 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ea804521-a5fd-4137-825e-f31914e39a98 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:03.933044 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ea804521-a5fd-4137-825e-f31914e39a98 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:03.933812 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ea804521-a5fd-4137-825e-f31914e39a98 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:03.934337 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ea804521-a5fd-4137-825e-f31914e39a98 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:03.934827 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ea804521-a5fd-4137-825e-f31914e39a98 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:04.080623 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ea804521-a5fd-4137-825e-f31914e39a98 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:04.088186 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ea804521-a5fd-4137-825e-f31914e39a98 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1359 microversion: 2.1 time: 0.170110 Aug 17 08:40:04.088747 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 128/260] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:03 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:04.145858 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-965d02a4-3f0e-43f7-9c50-e86b5a79edc0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:04.146460 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-965d02a4-3f0e-43f7-9c50-e86b5a79edc0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:04.152687 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-965d02a4-3f0e-43f7-9c50-e86b5a79edc0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:04.153171 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-965d02a4-3f0e-43f7-9c50-e86b5a79edc0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:04.153612 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-965d02a4-3f0e-43f7-9c50-e86b5a79edc0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:04.154288 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-965d02a4-3f0e-43f7-9c50-e86b5a79edc0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:04.154738 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-965d02a4-3f0e-43f7-9c50-e86b5a79edc0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:04.155812 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-965d02a4-3f0e-43f7-9c50-e86b5a79edc0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:04.184557 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-a1ffb00d-5628-4f30-b071-4f6c68d63a7e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Flavor limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 08:40:04.185208 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-a1ffb00d-5628-4f30-b071-4f6c68d63a7e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Image limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 08:40:04.185680 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-a1ffb00d-5628-4f30-b071-4f6c68d63a7e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Flavor pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 08:40:04.186085 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-a1ffb00d-5628-4f30-b071-4f6c68d63a7e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Image pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 08:40:04.186765 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-a1ffb00d-5628-4f30-b071-4f6c68d63a7e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 08:40:04.196316 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a1ffb00d-5628-4f30-b071-4f6c68d63a7e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:04.196870 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a1ffb00d-5628-4f30-b071-4f6c68d63a7e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:04.197308 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a1ffb00d-5628-4f30-b071-4f6c68d63a7e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:04.198041 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a1ffb00d-5628-4f30-b071-4f6c68d63a7e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:04.198516 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a1ffb00d-5628-4f30-b071-4f6c68d63a7e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:04.198931 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a1ffb00d-5628-4f30-b071-4f6c68d63a7e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:04.218499 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-a1ffb00d-5628-4f30-b071-4f6c68d63a7e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Getting quotas for project 4c20360aec7a4d60b7260305ab7e1b2f. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:40:04.220101 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-965d02a4-3f0e-43f7-9c50-e86b5a79edc0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:04.222565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-a1ffb00d-5628-4f30-b071-4f6c68d63a7e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Getting quotas for user 75a21876665f41c181a033dce1b0cea2 and project 4c20360aec7a4d60b7260305ab7e1b2f. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:40:04.228011 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-965d02a4-3f0e-43f7-9c50-e86b5a79edc0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1139 microversion: 2.1 time: 0.085857 Aug 17 08:40:04.234899 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a1ffb00d-5628-4f30-b071-4f6c68d63a7e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Going to run 1 instances... {{(pid=127297) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 08:40:04.237032 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a1ffb00d-5628-4f30-b071-4f6c68d63a7e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: ce091a0c-0dc8-49aa-9ac6-d794a2dba74b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4467450c-a35c-42e3-af85-a13291b0b2aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 08:40:04.239207 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 129/261] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:04 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1139 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:40:04.282424 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a1ffb00d-5628-4f30-b071-4f6c68d63a7e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.623951 Aug 17 08:40:04.283261 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 133/262] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 08:40:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 08:40:04.294781 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-08ee41f6-600a-43a3-832a-ecc0467f91a6 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:04.295435 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-08ee41f6-600a-43a3-832a-ecc0467f91a6 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: ce091a0c-0dc8-49aa-9ac6-d794a2dba74b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:04.357058 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-08ee41f6-600a-43a3-832a-ecc0467f91a6 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:04.364075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-08ee41f6-600a-43a3-832a-ecc0467f91a6 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b" status: 200 len: 1219 microversion: 2.1 time: 0.073799 Aug 17 08:40:04.364633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 130/263] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:04 2022] GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:04.472100 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-aca28df1-217a-4c28-bc13-579a000de49c tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:04.472716 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-aca28df1-217a-4c28-bc13-579a000de49c tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:04.479260 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aca28df1-217a-4c28-bc13-579a000de49c tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:04.479775 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aca28df1-217a-4c28-bc13-579a000de49c tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:04.480432 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aca28df1-217a-4c28-bc13-579a000de49c tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:04.481121 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aca28df1-217a-4c28-bc13-579a000de49c tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:04.481575 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aca28df1-217a-4c28-bc13-579a000de49c tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:04.481998 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aca28df1-217a-4c28-bc13-579a000de49c tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:04.613374 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-aca28df1-217a-4c28-bc13-579a000de49c tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:04.621438 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-aca28df1-217a-4c28-bc13-579a000de49c tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1723 microversion: 2.1 time: 0.153649 Aug 17 08:40:04.622005 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 134/264] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:04 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:04.930356 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5740eefe-5ee1-42da-b1a3-9939d841754a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:04.931314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5740eefe-5ee1-42da-b1a3-9939d841754a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:04.940935 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5740eefe-5ee1-42da-b1a3-9939d841754a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:04.941663 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5740eefe-5ee1-42da-b1a3-9939d841754a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:04.942487 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5740eefe-5ee1-42da-b1a3-9939d841754a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:04.943251 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5740eefe-5ee1-42da-b1a3-9939d841754a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:04.943973 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5740eefe-5ee1-42da-b1a3-9939d841754a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:04.944468 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5740eefe-5ee1-42da-b1a3-9939d841754a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:05.111699 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3e61b550-6405-4d2d-8c9d-23fa7c551807 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:05.112488 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3e61b550-6405-4d2d-8c9d-23fa7c551807 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:05.123822 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e61b550-6405-4d2d-8c9d-23fa7c551807 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:05.126419 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e61b550-6405-4d2d-8c9d-23fa7c551807 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:05.127117 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e61b550-6405-4d2d-8c9d-23fa7c551807 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:05.128399 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e61b550-6405-4d2d-8c9d-23fa7c551807 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:05.132970 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e61b550-6405-4d2d-8c9d-23fa7c551807 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:05.133911 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e61b550-6405-4d2d-8c9d-23fa7c551807 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:05.140013 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5740eefe-5ee1-42da-b1a3-9939d841754a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:05.162827 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5740eefe-5ee1-42da-b1a3-9939d841754a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1510 microversion: 2.1 time: 0.236748 Aug 17 08:40:05.163420 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 131/265] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:04 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1510 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:05.167455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=100 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:05.250522 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ea00bd49-b786-4766-b1ba-fbd531d8eba5 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:05.251384 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ea00bd49-b786-4766-b1ba-fbd531d8eba5 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:05.259210 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ea00bd49-b786-4766-b1ba-fbd531d8eba5 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:05.259954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ea00bd49-b786-4766-b1ba-fbd531d8eba5 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:05.260450 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ea00bd49-b786-4766-b1ba-fbd531d8eba5 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:05.261504 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ea00bd49-b786-4766-b1ba-fbd531d8eba5 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:05.261953 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ea00bd49-b786-4766-b1ba-fbd531d8eba5 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:05.262369 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ea00bd49-b786-4766-b1ba-fbd531d8eba5 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:05.330994 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ea00bd49-b786-4766-b1ba-fbd531d8eba5 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:05.339269 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ea00bd49-b786-4766-b1ba-fbd531d8eba5 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1131 microversion: 2.1 time: 0.094034 Aug 17 08:40:05.344068 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 132/266] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:05 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1131 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:05.388444 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3e61b550-6405-4d2d-8c9d-23fa7c551807 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:05.389671 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ee5ab2ad-43d7-45d6-a46f-4d203f207546 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:05.394750 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ee5ab2ad-43d7-45d6-a46f-4d203f207546 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: ce091a0c-0dc8-49aa-9ac6-d794a2dba74b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:05.398407 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3e61b550-6405-4d2d-8c9d-23fa7c551807 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1359 microversion: 2.1 time: 0.292387 Aug 17 08:40:05.411077 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee5ab2ad-43d7-45d6-a46f-4d203f207546 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:05.411958 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 135/267] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:05 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1359 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:40:05.414575 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee5ab2ad-43d7-45d6-a46f-4d203f207546 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:05.416072 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee5ab2ad-43d7-45d6-a46f-4d203f207546 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:05.416983 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee5ab2ad-43d7-45d6-a46f-4d203f207546 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:05.417517 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee5ab2ad-43d7-45d6-a46f-4d203f207546 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:05.417954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ee5ab2ad-43d7-45d6-a46f-4d203f207546 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:05.489908 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ee5ab2ad-43d7-45d6-a46f-4d203f207546 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:05.498159 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ee5ab2ad-43d7-45d6-a46f-4d203f207546 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b" status: 200 len: 1215 microversion: 2.1 time: 0.113723 Aug 17 08:40:05.498984 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 133/268] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:05 2022] GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b => generated 1215 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:05.646713 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-649af75d-fdb9-4ed4-9eca-54834f699487 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:05.647723 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-649af75d-fdb9-4ed4-9eca-54834f699487 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:05.656921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-649af75d-fdb9-4ed4-9eca-54834f699487 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:05.657723 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-649af75d-fdb9-4ed4-9eca-54834f699487 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:05.658393 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-649af75d-fdb9-4ed4-9eca-54834f699487 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:05.659307 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-649af75d-fdb9-4ed4-9eca-54834f699487 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:05.659845 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-649af75d-fdb9-4ed4-9eca-54834f699487 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:05.660362 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-649af75d-fdb9-4ed4-9eca-54834f699487 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:05.791455 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-604091d9-4ed4-40c8-b6da-b194b9081419 req-d6153d68-cb00-4e39-a292-278aae1b7e76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92675ce7-75fe-4b8e-afae-d1940474e4b7", "tag": "9f364177-8ecc-4da1-86aa-209bcf11e8dc"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:40:05.801449 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-604091d9-4ed4-40c8-b6da-b194b9081419 req-d6153d68-cb00-4e39-a292-278aae1b7e76 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:05.802009 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-604091d9-4ed4-40c8-b6da-b194b9081419 req-d6153d68-cb00-4e39-a292-278aae1b7e76 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:05.802686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-604091d9-4ed4-40c8-b6da-b194b9081419 req-d6153d68-cb00-4e39-a292-278aae1b7e76 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:05.814445 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-604091d9-4ed4-40c8-b6da-b194b9081419 req-d6153d68-cb00-4e39-a292-278aae1b7e76 service nova] Creating event network-changed:9f364177-8ecc-4da1-86aa-209bcf11e8dc for instance 92675ce7-75fe-4b8e-afae-d1940474e4b7 on hv-cinder-85331 Aug 17 08:40:05.819429 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-604091d9-4ed4-40c8-b6da-b194b9081419 req-d6153d68-cb00-4e39-a292-278aae1b7e76 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031939 Aug 17 08:40:05.820270 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 134/269] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:40:05.878194 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-649af75d-fdb9-4ed4-9eca-54834f699487 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:05.887318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-649af75d-fdb9-4ed4-9eca-54834f699487 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1700 microversion: 2.1 time: 0.248473 Aug 17 08:40:05.889936 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 136/270] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:05 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1700 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:05.909245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-eb04e0e3-cfb9-429a-aa03-f0c68a4bc48d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:40:05.915384 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eb04e0e3-cfb9-429a-aa03-f0c68a4bc48d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:05.915907 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eb04e0e3-cfb9-429a-aa03-f0c68a4bc48d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:05.916344 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eb04e0e3-cfb9-429a-aa03-f0c68a4bc48d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:06.113438 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-eb04e0e3-cfb9-429a-aa03-f0c68a4bc48d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Going to try to start instance {{(pid=127298) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 17 08:40:06.155819 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-eb04e0e3-cfb9-429a-aa03-f0c68a4bc48d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "POST /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9/action" status: 202 len: 0 microversion: 2.1 time: 0.251234 Aug 17 08:40:06.156441 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 135/271] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 08:40:05 2022] POST /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:40:06.164923 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-35a967cb-d31b-4c00-9bef-980849cf9803 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:06.165796 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-35a967cb-d31b-4c00-9bef-980849cf9803 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:06.171774 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-35a967cb-d31b-4c00-9bef-980849cf9803 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:06.172256 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-35a967cb-d31b-4c00-9bef-980849cf9803 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:06.172688 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-35a967cb-d31b-4c00-9bef-980849cf9803 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:06.173368 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-35a967cb-d31b-4c00-9bef-980849cf9803 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:06.173858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-35a967cb-d31b-4c00-9bef-980849cf9803 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:06.174353 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-35a967cb-d31b-4c00-9bef-980849cf9803 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:06.185175 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-255bf210-0c4e-4607-a22c-d48a1ce85061 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:06.186841 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-255bf210-0c4e-4607-a22c-d48a1ce85061 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:06.194234 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-255bf210-0c4e-4607-a22c-d48a1ce85061 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:06.194973 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-255bf210-0c4e-4607-a22c-d48a1ce85061 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:06.195731 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-255bf210-0c4e-4607-a22c-d48a1ce85061 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:06.196964 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-255bf210-0c4e-4607-a22c-d48a1ce85061 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:06.197581 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-255bf210-0c4e-4607-a22c-d48a1ce85061 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:06.198163 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-255bf210-0c4e-4607-a22c-d48a1ce85061 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:06.314316 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-35a967cb-d31b-4c00-9bef-980849cf9803 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:06.324491 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-35a967cb-d31b-4c00-9bef-980849cf9803 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1709 microversion: 2.1 time: 0.163789 Aug 17 08:40:06.325439 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 137/272] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:06 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1709 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:06.362996 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-cf0ef572-5691-4bf8-a154-36a79c84b436 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:06.363620 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-cf0ef572-5691-4bf8-a154-36a79c84b436 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:06.369750 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cf0ef572-5691-4bf8-a154-36a79c84b436 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:06.370208 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cf0ef572-5691-4bf8-a154-36a79c84b436 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:06.370809 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cf0ef572-5691-4bf8-a154-36a79c84b436 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:06.371503 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cf0ef572-5691-4bf8-a154-36a79c84b436 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:06.371975 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cf0ef572-5691-4bf8-a154-36a79c84b436 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:06.372393 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cf0ef572-5691-4bf8-a154-36a79c84b436 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:06.396800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-255bf210-0c4e-4607-a22c-d48a1ce85061 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:06.408077 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-255bf210-0c4e-4607-a22c-d48a1ce85061 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1510 microversion: 2.1 time: 0.227242 Aug 17 08:40:06.409744 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 136/273] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:06 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1510 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:06.421524 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-bdaed5ee-7931-4cc6-b4a2-dd89e4dec174 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:06.422405 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-bdaed5ee-7931-4cc6-b4a2-dd89e4dec174 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:06.428543 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bdaed5ee-7931-4cc6-b4a2-dd89e4dec174 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:06.429096 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bdaed5ee-7931-4cc6-b4a2-dd89e4dec174 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:06.429593 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bdaed5ee-7931-4cc6-b4a2-dd89e4dec174 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:06.430345 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bdaed5ee-7931-4cc6-b4a2-dd89e4dec174 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:06.430968 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bdaed5ee-7931-4cc6-b4a2-dd89e4dec174 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:06.431385 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bdaed5ee-7931-4cc6-b4a2-dd89e4dec174 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:06.458007 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-cf0ef572-5691-4bf8-a154-36a79c84b436 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:06.467022 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-cf0ef572-5691-4bf8-a154-36a79c84b436 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1131 microversion: 2.1 time: 0.107811 Aug 17 08:40:06.467898 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 138/274] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:06 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1131 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:06.520175 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0097b48a-5a1b-4237-96b6-3cc4216a070e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:06.521019 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0097b48a-5a1b-4237-96b6-3cc4216a070e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: ce091a0c-0dc8-49aa-9ac6-d794a2dba74b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:06.528138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0097b48a-5a1b-4237-96b6-3cc4216a070e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:06.537225 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0097b48a-5a1b-4237-96b6-3cc4216a070e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:06.537696 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0097b48a-5a1b-4237-96b6-3cc4216a070e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:06.539601 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0097b48a-5a1b-4237-96b6-3cc4216a070e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:06.540116 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0097b48a-5a1b-4237-96b6-3cc4216a070e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:06.540553 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0097b48a-5a1b-4237-96b6-3cc4216a070e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:06.570852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-bdaed5ee-7931-4cc6-b4a2-dd89e4dec174 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:06.578582 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-bdaed5ee-7931-4cc6-b4a2-dd89e4dec174 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1359 microversion: 2.1 time: 0.162421 Aug 17 08:40:06.579656 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 137/275] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:06 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:40:06.604920 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0097b48a-5a1b-4237-96b6-3cc4216a070e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:06.614878 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0097b48a-5a1b-4237-96b6-3cc4216a070e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b" status: 200 len: 1215 microversion: 2.1 time: 0.099961 Aug 17 08:40:06.615456 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 139/276] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:06 2022] GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b => generated 1215 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:40:07.347584 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ca5cfa21-6735-4cce-bd8a-4fa753d45657 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:07.348273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ca5cfa21-6735-4cce-bd8a-4fa753d45657 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:07.370596 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca5cfa21-6735-4cce-bd8a-4fa753d45657 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:07.371301 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca5cfa21-6735-4cce-bd8a-4fa753d45657 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:07.371823 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca5cfa21-6735-4cce-bd8a-4fa753d45657 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:07.372587 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca5cfa21-6735-4cce-bd8a-4fa753d45657 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:07.373279 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca5cfa21-6735-4cce-bd8a-4fa753d45657 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:07.374707 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca5cfa21-6735-4cce-bd8a-4fa753d45657 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:07.433759 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f218a314-9f7b-4d4b-ba18-43460ec3b34f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:07.435268 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f218a314-9f7b-4d4b-ba18-43460ec3b34f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:07.446754 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f218a314-9f7b-4d4b-ba18-43460ec3b34f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:07.447253 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f218a314-9f7b-4d4b-ba18-43460ec3b34f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:07.447760 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f218a314-9f7b-4d4b-ba18-43460ec3b34f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:07.448556 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f218a314-9f7b-4d4b-ba18-43460ec3b34f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:07.449011 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f218a314-9f7b-4d4b-ba18-43460ec3b34f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:07.449573 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f218a314-9f7b-4d4b-ba18-43460ec3b34f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:07.523801 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ca5cfa21-6735-4cce-bd8a-4fa753d45657 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:07.535060 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ca5cfa21-6735-4cce-bd8a-4fa753d45657 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1709 microversion: 2.1 time: 0.192711 Aug 17 08:40:07.537031 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 138/277] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:07 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1709 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:07.542361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-80ef4eac-e432-4a12-af10-103c353a6451 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:07.543315 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-80ef4eac-e432-4a12-af10-103c353a6451 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:07.551247 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-80ef4eac-e432-4a12-af10-103c353a6451 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:07.552256 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-80ef4eac-e432-4a12-af10-103c353a6451 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:07.552879 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-80ef4eac-e432-4a12-af10-103c353a6451 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:07.554046 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-80ef4eac-e432-4a12-af10-103c353a6451 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:07.554757 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-80ef4eac-e432-4a12-af10-103c353a6451 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:07.555380 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-80ef4eac-e432-4a12-af10-103c353a6451 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:07.650624 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-f218a314-9f7b-4d4b-ba18-43460ec3b34f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:07.654147 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-80ef4eac-e432-4a12-af10-103c353a6451 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:07.662951 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-80ef4eac-e432-4a12-af10-103c353a6451 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1187 microversion: 2.1 time: 0.124310 Aug 17 08:40:07.663917 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 139/278] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:07 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1187 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:07.668091 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-53ddbb39-301d-4e84-8b5b-5787e4c3ef8e tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:07.674734 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-53ddbb39-301d-4e84-8b5b-5787e4c3ef8e tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:07.680793 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f218a314-9f7b-4d4b-ba18-43460ec3b34f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1516 microversion: 2.1 time: 0.251989 Aug 17 08:40:07.682222 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 140/279] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:07 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1516 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:40:07.688117 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-53ddbb39-301d-4e84-8b5b-5787e4c3ef8e tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:07.688602 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-53ddbb39-301d-4e84-8b5b-5787e4c3ef8e tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:07.689034 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-53ddbb39-301d-4e84-8b5b-5787e4c3ef8e tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:07.689526 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-bf6e6610-fa5b-4d20-86b7-70f0ade29ed7 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:07.689718 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-53ddbb39-301d-4e84-8b5b-5787e4c3ef8e tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:07.692088 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-bf6e6610-fa5b-4d20-86b7-70f0ade29ed7 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: ce091a0c-0dc8-49aa-9ac6-d794a2dba74b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:07.694767 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-53ddbb39-301d-4e84-8b5b-5787e4c3ef8e tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:07.695324 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-53ddbb39-301d-4e84-8b5b-5787e4c3ef8e tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:07.719945 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bf6e6610-fa5b-4d20-86b7-70f0ade29ed7 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:07.722361 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bf6e6610-fa5b-4d20-86b7-70f0ade29ed7 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:07.724264 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bf6e6610-fa5b-4d20-86b7-70f0ade29ed7 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:07.725505 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bf6e6610-fa5b-4d20-86b7-70f0ade29ed7 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:07.726960 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bf6e6610-fa5b-4d20-86b7-70f0ade29ed7 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:07.727964 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bf6e6610-fa5b-4d20-86b7-70f0ade29ed7 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:08.094652 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-bf6e6610-fa5b-4d20-86b7-70f0ade29ed7 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:08.110495 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-bf6e6610-fa5b-4d20-86b7-70f0ade29ed7 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b" status: 200 len: 1215 microversion: 2.1 time: 0.426538 Aug 17 08:40:08.111927 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 141/280] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:07 2022] GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b => generated 1215 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:08.117870 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-53ddbb39-301d-4e84-8b5b-5787e4c3ef8e tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:08.122204 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:08.132490 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-53ddbb39-301d-4e84-8b5b-5787e4c3ef8e tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1359 microversion: 2.1 time: 0.467537 Aug 17 08:40:08.135197 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 140/281] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:07 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1359 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:08.559713 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-9071b69e-24df-43b7-a74f-b096f338236a tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:08.560317 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-9071b69e-24df-43b7-a74f-b096f338236a tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:08.568805 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9071b69e-24df-43b7-a74f-b096f338236a tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:08.569554 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9071b69e-24df-43b7-a74f-b096f338236a tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:08.570148 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9071b69e-24df-43b7-a74f-b096f338236a tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:08.571104 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9071b69e-24df-43b7-a74f-b096f338236a tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:08.571757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9071b69e-24df-43b7-a74f-b096f338236a tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:08.572345 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9071b69e-24df-43b7-a74f-b096f338236a tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:08.690614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c78397e2-16cc-4717-aa98-92fcc1cc3166 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:08.691533 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c78397e2-16cc-4717-aa98-92fcc1cc3166 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:08.701588 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c78397e2-16cc-4717-aa98-92fcc1cc3166 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:08.702252 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c78397e2-16cc-4717-aa98-92fcc1cc3166 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:08.702819 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c78397e2-16cc-4717-aa98-92fcc1cc3166 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:08.703664 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c78397e2-16cc-4717-aa98-92fcc1cc3166 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:08.704218 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c78397e2-16cc-4717-aa98-92fcc1cc3166 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:08.704737 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c78397e2-16cc-4717-aa98-92fcc1cc3166 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:08.804245 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-9071b69e-24df-43b7-a74f-b096f338236a tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:08.815426 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-9071b69e-24df-43b7-a74f-b096f338236a tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1709 microversion: 2.1 time: 0.261815 Aug 17 08:40:08.818104 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 142/282] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:08 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1709 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:08.862777 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c78397e2-16cc-4717-aa98-92fcc1cc3166 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:08.872598 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c78397e2-16cc-4717-aa98-92fcc1cc3166 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1205 microversion: 2.1 time: 0.188150 Aug 17 08:40:08.874571 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 141/283] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:08 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1205 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:09.137798 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-06e2aecd-c839-43fe-a724-9d1b15617a8e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:09.139122 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-06e2aecd-c839-43fe-a724-9d1b15617a8e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: ce091a0c-0dc8-49aa-9ac6-d794a2dba74b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:09.159030 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-25b33129-1233-4e8a-a8bf-d01dd46b13e9 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:09.160358 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-25b33129-1233-4e8a-a8bf-d01dd46b13e9 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:09.164275 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-06e2aecd-c839-43fe-a724-9d1b15617a8e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:09.167633 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-06e2aecd-c839-43fe-a724-9d1b15617a8e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:09.171137 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-06e2aecd-c839-43fe-a724-9d1b15617a8e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:09.173880 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-06e2aecd-c839-43fe-a724-9d1b15617a8e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:09.177672 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-06e2aecd-c839-43fe-a724-9d1b15617a8e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:09.178344 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-25b33129-1233-4e8a-a8bf-d01dd46b13e9 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:09.179838 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-06e2aecd-c839-43fe-a724-9d1b15617a8e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:09.182773 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-25b33129-1233-4e8a-a8bf-d01dd46b13e9 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:09.184218 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-25b33129-1233-4e8a-a8bf-d01dd46b13e9 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:09.187217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-25b33129-1233-4e8a-a8bf-d01dd46b13e9 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:09.187962 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-25b33129-1233-4e8a-a8bf-d01dd46b13e9 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:09.191226 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-25b33129-1233-4e8a-a8bf-d01dd46b13e9 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:09.470813 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-06e2aecd-c839-43fe-a724-9d1b15617a8e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:09.479582 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-06e2aecd-c839-43fe-a724-9d1b15617a8e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b" status: 200 len: 1319 microversion: 2.1 time: 0.348816 Aug 17 08:40:09.480263 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 143/284] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:09 2022] GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b => generated 1319 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:09.485319 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5b800d3f-b63f-4e6c-9d80-83863cf423ab tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Action: 'create', calling method: .version_select at 0x7f3f85daf280>, body: {"keypair": {"name": "tempest-keypair-1292866368", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDYfzji0nxeLf/ngv6ccYmFEZNDreZ32D3PLnFzqcyhoNMmmThTGQeXPc8p0B7bIHFCVTbYzJZTgVMcr7UBkgwLTbVhgWV9zC/XPNCximnkJb/l5oc+/uaIXwMDJkaACg=="}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:40:09.518758 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-5b800d3f-b63f-4e6c-9d80-83863cf423ab tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Getting quotas for project 2f3596b4a1404d3db340943fbd63567d. Resources: {'key_pairs'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:40:09.523131 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-5b800d3f-b63f-4e6c-9d80-83863cf423ab tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Getting quotas for user f051f99404fc4e0593553ae95e1f90d5 and project 2f3596b4a1404d3db340943fbd63567d. Resources: {'key_pairs'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:40:09.572912 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-5b800d3f-b63f-4e6c-9d80-83863cf423ab tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091522 Aug 17 08:40:09.573929 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 144/285] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 08:40:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:40:09.666826 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-25b33129-1233-4e8a-a8bf-d01dd46b13e9 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:09.679086 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-25b33129-1233-4e8a-a8bf-d01dd46b13e9 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1359 microversion: 2.1 time: 0.525557 Aug 17 08:40:09.679698 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 142/286] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:09 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1359 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:40:09.841800 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7bc59e4f-4941-491d-b872-027b777e4996 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:09.846858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7bc59e4f-4941-491d-b872-027b777e4996 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:09.857906 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7bc59e4f-4941-491d-b872-027b777e4996 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:09.859787 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7bc59e4f-4941-491d-b872-027b777e4996 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:09.860450 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7bc59e4f-4941-491d-b872-027b777e4996 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:09.862381 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7bc59e4f-4941-491d-b872-027b777e4996 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:09.863015 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7bc59e4f-4941-491d-b872-027b777e4996 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:09.874391 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7bc59e4f-4941-491d-b872-027b777e4996 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:09.895433 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-cc78d36f-c18d-4a25-8507-fceaa540561a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:09.896828 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-cc78d36f-c18d-4a25-8507-fceaa540561a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:09.906982 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cc78d36f-c18d-4a25-8507-fceaa540561a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:09.908018 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cc78d36f-c18d-4a25-8507-fceaa540561a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:09.908917 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cc78d36f-c18d-4a25-8507-fceaa540561a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:09.921179 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cc78d36f-c18d-4a25-8507-fceaa540561a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:09.921892 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cc78d36f-c18d-4a25-8507-fceaa540561a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:09.922595 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cc78d36f-c18d-4a25-8507-fceaa540561a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:10.146594 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-cc78d36f-c18d-4a25-8507-fceaa540561a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:10.156736 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-cc78d36f-c18d-4a25-8507-fceaa540561a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1260 microversion: 2.1 time: 0.265532 Aug 17 08:40:10.157350 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 143/287] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:09 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1260 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:10.338289 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-7bc59e4f-4941-491d-b872-027b777e4996 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:10.349444 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-7bc59e4f-4941-491d-b872-027b777e4996 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1709 microversion: 2.1 time: 0.513973 Aug 17 08:40:10.364910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 145/288] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:09 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1709 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:10.505002 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-976271d8-e667-43b8-8bb8-4057452db81f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:10.505885 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-976271d8-e667-43b8-8bb8-4057452db81f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: ce091a0c-0dc8-49aa-9ac6-d794a2dba74b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:10.523420 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-976271d8-e667-43b8-8bb8-4057452db81f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:10.525437 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-976271d8-e667-43b8-8bb8-4057452db81f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:10.526011 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-976271d8-e667-43b8-8bb8-4057452db81f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:10.526943 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-976271d8-e667-43b8-8bb8-4057452db81f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:10.532427 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-976271d8-e667-43b8-8bb8-4057452db81f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:10.533899 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-976271d8-e667-43b8-8bb8-4057452db81f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:10.589426 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-b43ce0e7-3030-4b58-a32c-6342504f6d8e req-1e41bd2d-ea3c-4afe-acc6-6112d560bffb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce091a0c-0dc8-49aa-9ac6-d794a2dba74b", "tag": "2c55b1fd-8986-45a0-ada6-fcef2d4bd388"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:40:10.616045 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-b43ce0e7-3030-4b58-a32c-6342504f6d8e req-1e41bd2d-ea3c-4afe-acc6-6112d560bffb service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:10.616820 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-b43ce0e7-3030-4b58-a32c-6342504f6d8e req-1e41bd2d-ea3c-4afe-acc6-6112d560bffb service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:10.617435 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-b43ce0e7-3030-4b58-a32c-6342504f6d8e req-1e41bd2d-ea3c-4afe-acc6-6112d560bffb service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:10.631217 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-b43ce0e7-3030-4b58-a32c-6342504f6d8e req-1e41bd2d-ea3c-4afe-acc6-6112d560bffb service nova] Creating event network-changed:2c55b1fd-8986-45a0-ada6-fcef2d4bd388 for instance ce091a0c-0dc8-49aa-9ac6-d794a2dba74b on hv-cinder-85331 Aug 17 08:40:10.636578 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-b43ce0e7-3030-4b58-a32c-6342504f6d8e req-1e41bd2d-ea3c-4afe-acc6-6112d560bffb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051357 Aug 17 08:40:10.637215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 146/289] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:40:10.705606 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8a48fcd3-9f7d-4d57-bba1-e43e6b38a889 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:10.706304 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8a48fcd3-9f7d-4d57-bba1-e43e6b38a889 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:10.713422 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a48fcd3-9f7d-4d57-bba1-e43e6b38a889 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:10.719024 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a48fcd3-9f7d-4d57-bba1-e43e6b38a889 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:10.719473 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a48fcd3-9f7d-4d57-bba1-e43e6b38a889 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:10.720223 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a48fcd3-9f7d-4d57-bba1-e43e6b38a889 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:10.720675 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a48fcd3-9f7d-4d57-bba1-e43e6b38a889 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:10.721217 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8a48fcd3-9f7d-4d57-bba1-e43e6b38a889 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:10.771477 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-976271d8-e667-43b8-8bb8-4057452db81f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:10.784050 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-976271d8-e667-43b8-8bb8-4057452db81f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b" status: 200 len: 1319 microversion: 2.1 time: 0.282805 Aug 17 08:40:10.785969 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 144/290] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:10 2022] GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:10.963517 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8a48fcd3-9f7d-4d57-bba1-e43e6b38a889 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:10.973622 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8a48fcd3-9f7d-4d57-bba1-e43e6b38a889 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1359 microversion: 2.1 time: 0.272557 Aug 17 08:40:10.974202 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 147/291] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:10 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1359 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:40:11.181137 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a511a016-b170-4ac3-a953-ca2b1b90fe20 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:11.183113 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a511a016-b170-4ac3-a953-ca2b1b90fe20 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:11.192780 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a511a016-b170-4ac3-a953-ca2b1b90fe20 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:11.193789 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a511a016-b170-4ac3-a953-ca2b1b90fe20 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:11.194455 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a511a016-b170-4ac3-a953-ca2b1b90fe20 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:11.195457 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a511a016-b170-4ac3-a953-ca2b1b90fe20 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:11.196124 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a511a016-b170-4ac3-a953-ca2b1b90fe20 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:11.196857 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a511a016-b170-4ac3-a953-ca2b1b90fe20 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:11.372245 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-284cdb8a-8be4-4d2a-8f9e-d4c8a18bb380 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:11.373157 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-284cdb8a-8be4-4d2a-8f9e-d4c8a18bb380 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:11.381223 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-284cdb8a-8be4-4d2a-8f9e-d4c8a18bb380 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:11.381909 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-284cdb8a-8be4-4d2a-8f9e-d4c8a18bb380 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:11.382946 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-284cdb8a-8be4-4d2a-8f9e-d4c8a18bb380 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:11.384065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-284cdb8a-8be4-4d2a-8f9e-d4c8a18bb380 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:11.384747 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-284cdb8a-8be4-4d2a-8f9e-d4c8a18bb380 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:11.385362 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-284cdb8a-8be4-4d2a-8f9e-d4c8a18bb380 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:11.430664 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a511a016-b170-4ac3-a953-ca2b1b90fe20 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:11.441477 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a511a016-b170-4ac3-a953-ca2b1b90fe20 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1260 microversion: 2.1 time: 0.266901 Aug 17 08:40:11.457008 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 145/292] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:11 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1260 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:11.457008 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-62710895-3094-4c87-9a5c-1eaaf7753d78 req-7a2d6cf0-097d-4f03-8d0d-1c591ea0f6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe1b2a32-cde6-43da-885e-78a42a55a7f1", "tag": "26fa0a6d-8a86-40e7-a48f-d1b7d96cfcfb"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:40:11.465773 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-62710895-3094-4c87-9a5c-1eaaf7753d78 req-7a2d6cf0-097d-4f03-8d0d-1c591ea0f6d8 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:11.466583 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-62710895-3094-4c87-9a5c-1eaaf7753d78 req-7a2d6cf0-097d-4f03-8d0d-1c591ea0f6d8 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:11.469172 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-62710895-3094-4c87-9a5c-1eaaf7753d78 req-7a2d6cf0-097d-4f03-8d0d-1c591ea0f6d8 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:11.486550 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-62710895-3094-4c87-9a5c-1eaaf7753d78 req-7a2d6cf0-097d-4f03-8d0d-1c591ea0f6d8 service nova] Creating event network-changed:26fa0a6d-8a86-40e7-a48f-d1b7d96cfcfb for instance fe1b2a32-cde6-43da-885e-78a42a55a7f1 on hv-cinder-85331 Aug 17 08:40:11.491847 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-62710895-3094-4c87-9a5c-1eaaf7753d78 req-7a2d6cf0-097d-4f03-8d0d-1c591ea0f6d8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046392 Aug 17 08:40:11.492325 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 146/293] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:40:11.757929 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-284cdb8a-8be4-4d2a-8f9e-d4c8a18bb380 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:11.765396 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-284cdb8a-8be4-4d2a-8f9e-d4c8a18bb380 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1713 microversion: 2.1 time: 0.398152 Aug 17 08:40:11.779778 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 148/294] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:11 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1713 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:11.809466 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6cf647ed-17a8-4a20-9c81-d4c606b14c11 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:11.810881 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6cf647ed-17a8-4a20-9c81-d4c606b14c11 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: ce091a0c-0dc8-49aa-9ac6-d794a2dba74b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:11.822717 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6cf647ed-17a8-4a20-9c81-d4c606b14c11 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:11.822717 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6cf647ed-17a8-4a20-9c81-d4c606b14c11 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:11.822717 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6cf647ed-17a8-4a20-9c81-d4c606b14c11 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:11.823339 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6cf647ed-17a8-4a20-9c81-d4c606b14c11 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:11.824459 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6cf647ed-17a8-4a20-9c81-d4c606b14c11 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:11.824459 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6cf647ed-17a8-4a20-9c81-d4c606b14c11 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:11.994356 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-000b06cf-b7f2-4e53-9fe8-305364fb22bb tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:11.994960 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-000b06cf-b7f2-4e53-9fe8-305364fb22bb tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:12.000977 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-000b06cf-b7f2-4e53-9fe8-305364fb22bb tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:12.001689 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-000b06cf-b7f2-4e53-9fe8-305364fb22bb tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:12.002306 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-000b06cf-b7f2-4e53-9fe8-305364fb22bb tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:12.003193 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-000b06cf-b7f2-4e53-9fe8-305364fb22bb tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:12.004082 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-000b06cf-b7f2-4e53-9fe8-305364fb22bb tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:12.004871 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-000b06cf-b7f2-4e53-9fe8-305364fb22bb tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:12.005148 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6cf647ed-17a8-4a20-9c81-d4c606b14c11 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:12.013995 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6cf647ed-17a8-4a20-9c81-d4c606b14c11 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b" status: 200 len: 1319 microversion: 2.1 time: 0.210680 Aug 17 08:40:12.014593 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 147/295] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:11 2022] GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:12.313484 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-000b06cf-b7f2-4e53-9fe8-305364fb22bb tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:12.323459 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-000b06cf-b7f2-4e53-9fe8-305364fb22bb tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1359 microversion: 2.1 time: 0.332992 Aug 17 08:40:12.324115 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 149/296] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:11 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1359 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:12.465235 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-526e582d-b369-4d7d-9c36-27031357d0ef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-570148649", "imageRef": "4467450c-a35c-42e3-af85-a13291b0b2aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f99d5d5e-b854-44c4-b2ed-25a3534627e4"}], "security_groups": [{"name": "tempest-securitygroup--1318449652"}], "key_name": "tempest-keypair-1292866368", "user_data": "}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:40:12.470211 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8e3d5efd-98b3-45df-9e8a-fa29390ab63a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:12.471765 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8e3d5efd-98b3-45df-9e8a-fa29390ab63a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:12.480823 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8e3d5efd-98b3-45df-9e8a-fa29390ab63a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:12.481668 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8e3d5efd-98b3-45df-9e8a-fa29390ab63a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:12.482434 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8e3d5efd-98b3-45df-9e8a-fa29390ab63a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:12.483940 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8e3d5efd-98b3-45df-9e8a-fa29390ab63a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:12.484566 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8e3d5efd-98b3-45df-9e8a-fa29390ab63a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:12.485143 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8e3d5efd-98b3-45df-9e8a-fa29390ab63a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:12.653850 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.network.neutron [None req-526e582d-b369-4d7d-9c36-27031357d0ef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] validate_networks() for [('f99d5d5e-b854-44c4-b2ed-25a3534627e4', None, None, None, None, None)] {{(pid=127297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 08:40:12.682883 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8e3d5efd-98b3-45df-9e8a-fa29390ab63a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:12.696741 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8e3d5efd-98b3-45df-9e8a-fa29390ab63a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1260 microversion: 2.1 time: 0.232248 Aug 17 08:40:12.707607 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 148/297] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:12 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1260 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:13.034144 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9d443305-9c1f-4367-8238-a89d98f9f3e0 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:13.034879 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9d443305-9c1f-4367-8238-a89d98f9f3e0 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: ce091a0c-0dc8-49aa-9ac6-d794a2dba74b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:13.040743 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9d443305-9c1f-4367-8238-a89d98f9f3e0 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:13.041230 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9d443305-9c1f-4367-8238-a89d98f9f3e0 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:13.041662 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9d443305-9c1f-4367-8238-a89d98f9f3e0 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:13.042342 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9d443305-9c1f-4367-8238-a89d98f9f3e0 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:13.042792 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9d443305-9c1f-4367-8238-a89d98f9f3e0 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:13.043208 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9d443305-9c1f-4367-8238-a89d98f9f3e0 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:13.054602 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-526e582d-b369-4d7d-9c36-27031357d0ef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Flavor limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 08:40:13.055066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-526e582d-b369-4d7d-9c36-27031357d0ef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Image limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 08:40:13.055464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-526e582d-b369-4d7d-9c36-27031357d0ef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Flavor pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 08:40:13.055893 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-526e582d-b369-4d7d-9c36-27031357d0ef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Image pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 08:40:13.056292 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-526e582d-b369-4d7d-9c36-27031357d0ef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 08:40:13.065399 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-526e582d-b369-4d7d-9c36-27031357d0ef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:13.065866 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-526e582d-b369-4d7d-9c36-27031357d0ef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:13.066291 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-526e582d-b369-4d7d-9c36-27031357d0ef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:13.066997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-526e582d-b369-4d7d-9c36-27031357d0ef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:13.067438 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-526e582d-b369-4d7d-9c36-27031357d0ef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:13.067903 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-526e582d-b369-4d7d-9c36-27031357d0ef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:13.086764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-526e582d-b369-4d7d-9c36-27031357d0ef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Getting quotas for project 2f3596b4a1404d3db340943fbd63567d. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:40:13.088995 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:13.091337 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-526e582d-b369-4d7d-9c36-27031357d0ef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Getting quotas for user f051f99404fc4e0593553ae95e1f90d5 and project 2f3596b4a1404d3db340943fbd63567d. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:40:13.103476 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-526e582d-b369-4d7d-9c36-27031357d0ef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Going to run 1 instances... {{(pid=127297) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 08:40:13.105761 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-526e582d-b369-4d7d-9c36-27031357d0ef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4467450c-a35c-42e3-af85-a13291b0b2aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 08:40:13.152724 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-526e582d-b369-4d7d-9c36-27031357d0ef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.691932 Aug 17 08:40:13.153532 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 150/298] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 08:40:12 2022] POST /compute/v2.1/servers => generated 409 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 08:40:13.163942 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-785a8a94-2a32-401a-b5c8-79d01e976034 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:13.164540 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-785a8a94-2a32-401a-b5c8-79d01e976034 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:13.176042 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-9d443305-9c1f-4367-8238-a89d98f9f3e0 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:13.183893 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9d443305-9c1f-4367-8238-a89d98f9f3e0 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b" status: 200 len: 1319 microversion: 2.1 time: 0.153108 Aug 17 08:40:13.184012 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 149/299] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:13 2022] GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:40:13.218071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-785a8a94-2a32-401a-b5c8-79d01e976034 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:13.226497 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-785a8a94-2a32-401a-b5c8-79d01e976034 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1245 microversion: 2.1 time: 0.066210 Aug 17 08:40:13.227061 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 151/300] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:13 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1245 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:40:13.348662 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0cc23732-8cf6-44f3-9e5b-82d8c8b5ae99 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:13.349255 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0cc23732-8cf6-44f3-9e5b-82d8c8b5ae99 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:13.351167 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:13.357420 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0cc23732-8cf6-44f3-9e5b-82d8c8b5ae99 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:13.358395 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0cc23732-8cf6-44f3-9e5b-82d8c8b5ae99 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:13.358824 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0cc23732-8cf6-44f3-9e5b-82d8c8b5ae99 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:13.359501 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0cc23732-8cf6-44f3-9e5b-82d8c8b5ae99 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:13.359967 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0cc23732-8cf6-44f3-9e5b-82d8c8b5ae99 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:13.360379 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0cc23732-8cf6-44f3-9e5b-82d8c8b5ae99 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:13.498534 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0cc23732-8cf6-44f3-9e5b-82d8c8b5ae99 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:13.506560 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0cc23732-8cf6-44f3-9e5b-82d8c8b5ae99 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1359 microversion: 2.1 time: 0.161862 Aug 17 08:40:13.511965 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 150/301] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:13 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:13.721919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-750fa878-1192-4e17-b04d-7ccac9fbba0b tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:13.722692 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-750fa878-1192-4e17-b04d-7ccac9fbba0b tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:13.729452 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-750fa878-1192-4e17-b04d-7ccac9fbba0b tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:13.730162 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-750fa878-1192-4e17-b04d-7ccac9fbba0b tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:13.730728 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-750fa878-1192-4e17-b04d-7ccac9fbba0b tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:13.731411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-750fa878-1192-4e17-b04d-7ccac9fbba0b tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:13.731887 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-750fa878-1192-4e17-b04d-7ccac9fbba0b tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:13.732301 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-750fa878-1192-4e17-b04d-7ccac9fbba0b tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:13.870209 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-750fa878-1192-4e17-b04d-7ccac9fbba0b tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:13.878546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-750fa878-1192-4e17-b04d-7ccac9fbba0b tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1260 microversion: 2.1 time: 0.161766 Aug 17 08:40:13.879114 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 152/302] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:13 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:14.205756 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-756106ec-e579-44e9-b609-bcc0d6f992df tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:14.206382 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-756106ec-e579-44e9-b609-bcc0d6f992df tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: ce091a0c-0dc8-49aa-9ac6-d794a2dba74b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:14.214968 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-756106ec-e579-44e9-b609-bcc0d6f992df tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:14.215481 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-756106ec-e579-44e9-b609-bcc0d6f992df tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:14.215916 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-756106ec-e579-44e9-b609-bcc0d6f992df tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:14.216618 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-756106ec-e579-44e9-b609-bcc0d6f992df tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:14.220235 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-756106ec-e579-44e9-b609-bcc0d6f992df tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:14.220822 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-756106ec-e579-44e9-b609-bcc0d6f992df tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:14.250178 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-fb49d3cf-8df2-4208-b71b-c1b517ac649a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:14.250906 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fb49d3cf-8df2-4208-b71b-c1b517ac649a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:14.259797 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fb49d3cf-8df2-4208-b71b-c1b517ac649a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:14.260799 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fb49d3cf-8df2-4208-b71b-c1b517ac649a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:14.261607 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fb49d3cf-8df2-4208-b71b-c1b517ac649a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:14.263280 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fb49d3cf-8df2-4208-b71b-c1b517ac649a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:14.265071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fb49d3cf-8df2-4208-b71b-c1b517ac649a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:14.265758 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fb49d3cf-8df2-4208-b71b-c1b517ac649a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:14.361365 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=10 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:14.376948 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-fb49d3cf-8df2-4208-b71b-c1b517ac649a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:14.386459 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-fb49d3cf-8df2-4208-b71b-c1b517ac649a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1305 microversion: 2.1 time: 0.141952 Aug 17 08:40:14.387055 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 153/303] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:14 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1305 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:14.396136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-184a6e0b-d423-4187-8400-b24490ce07d3 req-a6be5194-25bb-4fbf-b756-fbb0845655f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92675ce7-75fe-4b8e-afae-d1940474e4b7", "name": "network-vif-plugged", "status": "completed", "tag": "9f364177-8ecc-4da1-86aa-209bcf11e8dc"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:40:14.415238 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-184a6e0b-d423-4187-8400-b24490ce07d3 req-a6be5194-25bb-4fbf-b756-fbb0845655f2 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:14.415748 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-184a6e0b-d423-4187-8400-b24490ce07d3 req-a6be5194-25bb-4fbf-b756-fbb0845655f2 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:14.416181 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-184a6e0b-d423-4187-8400-b24490ce07d3 req-a6be5194-25bb-4fbf-b756-fbb0845655f2 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:14.431423 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-184a6e0b-d423-4187-8400-b24490ce07d3 req-a6be5194-25bb-4fbf-b756-fbb0845655f2 service nova] Creating event network-vif-plugged:9f364177-8ecc-4da1-86aa-209bcf11e8dc for instance 92675ce7-75fe-4b8e-afae-d1940474e4b7 on hv-cinder-85331 Aug 17 08:40:14.437175 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-184a6e0b-d423-4187-8400-b24490ce07d3 req-a6be5194-25bb-4fbf-b756-fbb0845655f2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048967 Aug 17 08:40:14.442085 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 154/304] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:40:14.529424 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d595ae39-5b56-41c2-b92f-fee589f13806 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:14.530610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d595ae39-5b56-41c2-b92f-fee589f13806 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:14.537740 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d595ae39-5b56-41c2-b92f-fee589f13806 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:14.538859 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d595ae39-5b56-41c2-b92f-fee589f13806 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:14.539755 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d595ae39-5b56-41c2-b92f-fee589f13806 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:14.540053 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d595ae39-5b56-41c2-b92f-fee589f13806 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:14.540512 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d595ae39-5b56-41c2-b92f-fee589f13806 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:14.541116 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d595ae39-5b56-41c2-b92f-fee589f13806 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:14.564274 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-756106ec-e579-44e9-b609-bcc0d6f992df tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:14.576228 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-756106ec-e579-44e9-b609-bcc0d6f992df tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b" status: 200 len: 1319 microversion: 2.1 time: 0.375218 Aug 17 08:40:14.587568 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 151/305] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:14 2022] GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:14.702876 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d595ae39-5b56-41c2-b92f-fee589f13806 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:14.711648 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d595ae39-5b56-41c2-b92f-fee589f13806 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1359 microversion: 2.1 time: 0.187453 Aug 17 08:40:14.712672 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 155/306] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:14 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:14.900551 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-96e9bc6c-5aeb-4a4a-a344-ca21bc5ece46 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:14.901154 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-96e9bc6c-5aeb-4a4a-a344-ca21bc5ece46 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:14.908898 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-96e9bc6c-5aeb-4a4a-a344-ca21bc5ece46 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:14.909374 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-96e9bc6c-5aeb-4a4a-a344-ca21bc5ece46 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:14.909820 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-96e9bc6c-5aeb-4a4a-a344-ca21bc5ece46 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:14.910478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-96e9bc6c-5aeb-4a4a-a344-ca21bc5ece46 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:14.910927 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-96e9bc6c-5aeb-4a4a-a344-ca21bc5ece46 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:14.911346 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-96e9bc6c-5aeb-4a4a-a344-ca21bc5ece46 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:15.131630 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-96e9bc6c-5aeb-4a4a-a344-ca21bc5ece46 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:15.139581 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-96e9bc6c-5aeb-4a4a-a344-ca21bc5ece46 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1260 microversion: 2.1 time: 0.243822 Aug 17 08:40:15.140370 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 152/307] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:14 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1260 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:15.410956 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2b52c6de-dfe9-416e-a340-2e8b4d041e6a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:15.412172 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-2b52c6de-dfe9-416e-a340-2e8b4d041e6a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:15.421736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2b52c6de-dfe9-416e-a340-2e8b4d041e6a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:15.422225 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2b52c6de-dfe9-416e-a340-2e8b4d041e6a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:15.422957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2b52c6de-dfe9-416e-a340-2e8b4d041e6a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:15.424162 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2b52c6de-dfe9-416e-a340-2e8b4d041e6a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:15.424772 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2b52c6de-dfe9-416e-a340-2e8b4d041e6a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:15.426044 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2b52c6de-dfe9-416e-a340-2e8b4d041e6a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:15.431709 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=100 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:15.578661 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-2b52c6de-dfe9-416e-a340-2e8b4d041e6a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:15.587776 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2b52c6de-dfe9-416e-a340-2e8b4d041e6a tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1371 microversion: 2.1 time: 0.180649 Aug 17 08:40:15.602117 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 156/308] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:15 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:15.606911 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1fdc03f0-c69e-4f62-8d93-bd4afc2b44eb tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:15.617026 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1fdc03f0-c69e-4f62-8d93-bd4afc2b44eb tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: ce091a0c-0dc8-49aa-9ac6-d794a2dba74b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:15.627863 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1fdc03f0-c69e-4f62-8d93-bd4afc2b44eb tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:15.638483 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1fdc03f0-c69e-4f62-8d93-bd4afc2b44eb tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:15.639481 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1fdc03f0-c69e-4f62-8d93-bd4afc2b44eb tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:15.640265 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1fdc03f0-c69e-4f62-8d93-bd4afc2b44eb tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:15.640720 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1fdc03f0-c69e-4f62-8d93-bd4afc2b44eb tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:15.641171 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1fdc03f0-c69e-4f62-8d93-bd4afc2b44eb tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:15.732493 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-fdcbbee8-ac9c-483a-85ca-2edb449259b0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:15.733338 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fdcbbee8-ac9c-483a-85ca-2edb449259b0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:15.739319 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fdcbbee8-ac9c-483a-85ca-2edb449259b0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:15.739858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fdcbbee8-ac9c-483a-85ca-2edb449259b0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:15.740289 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fdcbbee8-ac9c-483a-85ca-2edb449259b0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:15.740972 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fdcbbee8-ac9c-483a-85ca-2edb449259b0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:15.741424 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fdcbbee8-ac9c-483a-85ca-2edb449259b0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:15.741842 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fdcbbee8-ac9c-483a-85ca-2edb449259b0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:16.052812 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-fdcbbee8-ac9c-483a-85ca-2edb449259b0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:16.061489 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-fdcbbee8-ac9c-483a-85ca-2edb449259b0 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1359 microversion: 2.1 time: 0.332157 Aug 17 08:40:16.062077 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 157/309] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:15 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1359 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:40:16.163408 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-362a849e-eb64-4c7a-8395-03b8779092c7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:16.165121 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-362a849e-eb64-4c7a-8395-03b8779092c7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:16.172769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-362a849e-eb64-4c7a-8395-03b8779092c7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:16.173446 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-362a849e-eb64-4c7a-8395-03b8779092c7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:16.173979 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-362a849e-eb64-4c7a-8395-03b8779092c7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:16.174973 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-362a849e-eb64-4c7a-8395-03b8779092c7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:16.175528 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-362a849e-eb64-4c7a-8395-03b8779092c7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:16.176138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-362a849e-eb64-4c7a-8395-03b8779092c7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:16.182192 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1fdc03f0-c69e-4f62-8d93-bd4afc2b44eb tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:16.195618 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1fdc03f0-c69e-4f62-8d93-bd4afc2b44eb tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b" status: 200 len: 1319 microversion: 2.1 time: 0.595987 Aug 17 08:40:16.197291 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 153/310] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:15 2022] GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b => generated 1319 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:16.343002 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-362a849e-eb64-4c7a-8395-03b8779092c7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:16.357426 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-362a849e-eb64-4c7a-8395-03b8779092c7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1260 microversion: 2.1 time: 0.199147 Aug 17 08:40:16.358805 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 158/311] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:16 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1260 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:16.597946 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-0f780441-7feb-4fa7-875d-3fbfcd0816ec req-4481f8bb-70d5-4173-9f39-259bade0370d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1", "tag": "07a04b7d-775b-4a78-95c5-7fe56d001b03"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:40:16.610170 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-24176095-c2cb-4680-b1f0-48b28c195852 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:16.610778 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-24176095-c2cb-4680-b1f0-48b28c195852 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:16.615322 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-0f780441-7feb-4fa7-875d-3fbfcd0816ec req-4481f8bb-70d5-4173-9f39-259bade0370d service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:16.616398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-0f780441-7feb-4fa7-875d-3fbfcd0816ec req-4481f8bb-70d5-4173-9f39-259bade0370d service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:16.617221 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-0f780441-7feb-4fa7-875d-3fbfcd0816ec req-4481f8bb-70d5-4173-9f39-259bade0370d service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:16.617352 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-24176095-c2cb-4680-b1f0-48b28c195852 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:16.617708 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-24176095-c2cb-4680-b1f0-48b28c195852 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:16.618196 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-24176095-c2cb-4680-b1f0-48b28c195852 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:16.619002 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-24176095-c2cb-4680-b1f0-48b28c195852 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:16.619660 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-24176095-c2cb-4680-b1f0-48b28c195852 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:16.620443 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-24176095-c2cb-4680-b1f0-48b28c195852 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:16.630350 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-0f780441-7feb-4fa7-875d-3fbfcd0816ec req-4481f8bb-70d5-4173-9f39-259bade0370d service nova] Creating event network-changed:07a04b7d-775b-4a78-95c5-7fe56d001b03 for instance 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 on hv-cinder-85331 Aug 17 08:40:16.635448 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-0f780441-7feb-4fa7-875d-3fbfcd0816ec req-4481f8bb-70d5-4173-9f39-259bade0370d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041187 Aug 17 08:40:16.636587 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 154/312] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:40:16.784724 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-24176095-c2cb-4680-b1f0-48b28c195852 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:16.792252 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-24176095-c2cb-4680-b1f0-48b28c195852 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1371 microversion: 2.1 time: 0.186919 Aug 17 08:40:16.792826 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 159/313] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:16 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:40:17.083389 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9dfd6e55-9756-4ebd-a8ae-a8560406d2e8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:17.084411 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9dfd6e55-9756-4ebd-a8ae-a8560406d2e8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:17.090932 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9dfd6e55-9756-4ebd-a8ae-a8560406d2e8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:17.091349 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9dfd6e55-9756-4ebd-a8ae-a8560406d2e8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:17.091807 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9dfd6e55-9756-4ebd-a8ae-a8560406d2e8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:17.092532 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9dfd6e55-9756-4ebd-a8ae-a8560406d2e8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:17.092979 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9dfd6e55-9756-4ebd-a8ae-a8560406d2e8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:17.093398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9dfd6e55-9756-4ebd-a8ae-a8560406d2e8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:17.219840 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d2fd054a-ed73-41dd-b8ea-1b30635fe7f2 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:17.220535 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d2fd054a-ed73-41dd-b8ea-1b30635fe7f2 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: ce091a0c-0dc8-49aa-9ac6-d794a2dba74b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:17.226583 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2fd054a-ed73-41dd-b8ea-1b30635fe7f2 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:17.227158 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2fd054a-ed73-41dd-b8ea-1b30635fe7f2 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:17.227620 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2fd054a-ed73-41dd-b8ea-1b30635fe7f2 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:17.228311 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2fd054a-ed73-41dd-b8ea-1b30635fe7f2 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:17.228761 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2fd054a-ed73-41dd-b8ea-1b30635fe7f2 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:17.229178 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2fd054a-ed73-41dd-b8ea-1b30635fe7f2 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:17.270412 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-9dfd6e55-9756-4ebd-a8ae-a8560406d2e8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:17.278164 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9dfd6e55-9756-4ebd-a8ae-a8560406d2e8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1547 microversion: 2.1 time: 0.199249 Aug 17 08:40:17.278743 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 155/314] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:17 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1547 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:17.299745 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-00bbbe4a-a237-4a4c-ad89-2d0988b2faa8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:17.300369 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-00bbbe4a-a237-4a4c-ad89-2d0988b2faa8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:17.306245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-00bbbe4a-a237-4a4c-ad89-2d0988b2faa8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:17.306721 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-00bbbe4a-a237-4a4c-ad89-2d0988b2faa8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:17.307146 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-00bbbe4a-a237-4a4c-ad89-2d0988b2faa8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:17.307881 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-00bbbe4a-a237-4a4c-ad89-2d0988b2faa8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:17.308320 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-00bbbe4a-a237-4a4c-ad89-2d0988b2faa8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:17.308731 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-00bbbe4a-a237-4a4c-ad89-2d0988b2faa8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:17.366732 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d2fd054a-ed73-41dd-b8ea-1b30635fe7f2 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:17.374645 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d2fd054a-ed73-41dd-b8ea-1b30635fe7f2 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b" status: 200 len: 1319 microversion: 2.1 time: 0.158924 Aug 17 08:40:17.387571 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 160/315] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:17 2022] GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:40:17.387571 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-aa412185-ef50-4fba-b804-22e6e04d0df0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:17.387571 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-aa412185-ef50-4fba-b804-22e6e04d0df0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:17.387571 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aa412185-ef50-4fba-b804-22e6e04d0df0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:17.387571 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aa412185-ef50-4fba-b804-22e6e04d0df0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:17.388084 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aa412185-ef50-4fba-b804-22e6e04d0df0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:17.388449 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aa412185-ef50-4fba-b804-22e6e04d0df0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:17.388895 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aa412185-ef50-4fba-b804-22e6e04d0df0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:17.389365 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aa412185-ef50-4fba-b804-22e6e04d0df0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:17.478524 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-00bbbe4a-a237-4a4c-ad89-2d0988b2faa8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:17.486778 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-00bbbe4a-a237-4a4c-ad89-2d0988b2faa8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1547 microversion: 2.1 time: 0.191545 Aug 17 08:40:17.487352 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 156/316] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:17 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1547 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:40:17.505946 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-cb44c7e3-3812-4bae-a90c-f87e507b6b81 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:17.510703 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-cb44c7e3-3812-4bae-a90c-f87e507b6b81 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:17.511437 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-cb44c7e3-3812-4bae-a90c-f87e507b6b81 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Searching by: {'deleted': False, 'project_id': '8c0e70db84d64777af111825ff71df8c'} {{(pid=127298) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 17 08:40:17.518988 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cb44c7e3-3812-4bae-a90c-f87e507b6b81 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:17.519671 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cb44c7e3-3812-4bae-a90c-f87e507b6b81 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:17.520358 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cb44c7e3-3812-4bae-a90c-f87e507b6b81 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:17.521126 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cb44c7e3-3812-4bae-a90c-f87e507b6b81 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:17.523897 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cb44c7e3-3812-4bae-a90c-f87e507b6b81 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:17.524459 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cb44c7e3-3812-4bae-a90c-f87e507b6b81 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:17.525180 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-aa412185-ef50-4fba-b804-22e6e04d0df0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:17.534531 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-aa412185-ef50-4fba-b804-22e6e04d0df0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1260 microversion: 2.1 time: 0.158122 Aug 17 08:40:17.535186 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 161/317] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:17 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:17.618403 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.multi_cell_list [None req-cb44c7e3-3812-4bae-a90c-f87e507b6b81 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127298) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 17 08:40:17.714755 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-cb44c7e3-3812-4bae-a90c-f87e507b6b81 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.212394 Aug 17 08:40:17.715335 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 157/318] 10.222.0.15 () {58 vars in 1125 bytes} [Wed Aug 17 08:40:17 2022] GET /compute/v2.1/servers => generated 343 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:40:17.727154 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-32c68e18-43d2-43e9-8451-8f8772727e1c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:17.727792 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-32c68e18-43d2-43e9-8451-8f8772727e1c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:17.734627 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-32c68e18-43d2-43e9-8451-8f8772727e1c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:17.735098 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-32c68e18-43d2-43e9-8451-8f8772727e1c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:17.735528 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-32c68e18-43d2-43e9-8451-8f8772727e1c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:17.736228 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-32c68e18-43d2-43e9-8451-8f8772727e1c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:17.736680 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-32c68e18-43d2-43e9-8451-8f8772727e1c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:17.737098 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-32c68e18-43d2-43e9-8451-8f8772727e1c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:17.813397 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-616585b7-11a0-4d67-b66b-b6f52a2b7a6c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:17.814003 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-616585b7-11a0-4d67-b66b-b6f52a2b7a6c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:17.819975 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-616585b7-11a0-4d67-b66b-b6f52a2b7a6c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:17.820453 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-616585b7-11a0-4d67-b66b-b6f52a2b7a6c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:17.820883 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-616585b7-11a0-4d67-b66b-b6f52a2b7a6c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:17.821562 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-616585b7-11a0-4d67-b66b-b6f52a2b7a6c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:17.822008 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-616585b7-11a0-4d67-b66b-b6f52a2b7a6c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:17.822429 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-616585b7-11a0-4d67-b66b-b6f52a2b7a6c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:17.843502 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=100 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:17.871942 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-32c68e18-43d2-43e9-8451-8f8772727e1c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:17.880092 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-32c68e18-43d2-43e9-8451-8f8772727e1c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1547 microversion: 2.1 time: 0.156790 Aug 17 08:40:17.880672 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 162/319] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:17 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:17.961950 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-616585b7-11a0-4d67-b66b-b6f52a2b7a6c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:17.969442 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-616585b7-11a0-4d67-b66b-b6f52a2b7a6c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1371 microversion: 2.1 time: 0.160517 Aug 17 08:40:17.970020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 158/320] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:17 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:40:18.330270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-eccf3a09-c056-466d-be2d-040c7dbf7347 req-9a0e7f13-fca2-41b8-982d-bab99a593a7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce091a0c-0dc8-49aa-9ac6-d794a2dba74b", "name": "network-vif-plugged", "status": "completed", "tag": "2c55b1fd-8986-45a0-ada6-fcef2d4bd388"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:40:18.340393 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-eccf3a09-c056-466d-be2d-040c7dbf7347 req-9a0e7f13-fca2-41b8-982d-bab99a593a7c service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:18.340872 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-eccf3a09-c056-466d-be2d-040c7dbf7347 req-9a0e7f13-fca2-41b8-982d-bab99a593a7c service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:18.341300 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-eccf3a09-c056-466d-be2d-040c7dbf7347 req-9a0e7f13-fca2-41b8-982d-bab99a593a7c service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:18.376674 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-eccf3a09-c056-466d-be2d-040c7dbf7347 req-9a0e7f13-fca2-41b8-982d-bab99a593a7c service nova] Creating event network-vif-plugged:2c55b1fd-8986-45a0-ada6-fcef2d4bd388 for instance ce091a0c-0dc8-49aa-9ac6-d794a2dba74b on hv-cinder-85331 Aug 17 08:40:18.381814 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-eccf3a09-c056-466d-be2d-040c7dbf7347 req-9a0e7f13-fca2-41b8-982d-bab99a593a7c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056238 Aug 17 08:40:18.384562 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 163/321] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:40:18.396573 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0750df8c-8c98-46f0-8fda-822faabda3cf tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:18.397345 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0750df8c-8c98-46f0-8fda-822faabda3cf tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: ce091a0c-0dc8-49aa-9ac6-d794a2dba74b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:18.403706 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0750df8c-8c98-46f0-8fda-822faabda3cf tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:18.404181 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0750df8c-8c98-46f0-8fda-822faabda3cf tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:18.404638 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0750df8c-8c98-46f0-8fda-822faabda3cf tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:18.405346 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0750df8c-8c98-46f0-8fda-822faabda3cf tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:18.405788 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0750df8c-8c98-46f0-8fda-822faabda3cf tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:18.406195 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0750df8c-8c98-46f0-8fda-822faabda3cf tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:18.555729 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0fdafe85-ce99-46a3-b401-622659d67460 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:18.556839 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0fdafe85-ce99-46a3-b401-622659d67460 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:18.564146 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0fdafe85-ce99-46a3-b401-622659d67460 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:18.564649 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0fdafe85-ce99-46a3-b401-622659d67460 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:18.565252 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0fdafe85-ce99-46a3-b401-622659d67460 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:18.565937 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0fdafe85-ce99-46a3-b401-622659d67460 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:18.566380 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0fdafe85-ce99-46a3-b401-622659d67460 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:18.566824 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0fdafe85-ce99-46a3-b401-622659d67460 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:18.617488 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0750df8c-8c98-46f0-8fda-822faabda3cf tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:18.628906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0750df8c-8c98-46f0-8fda-822faabda3cf tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b" status: 200 len: 1319 microversion: 2.1 time: 0.236481 Aug 17 08:40:18.629721 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 159/322] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:18 2022] GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:18.722961 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0fdafe85-ce99-46a3-b401-622659d67460 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:18.730513 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0fdafe85-ce99-46a3-b401-622659d67460 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1260 microversion: 2.1 time: 0.179333 Aug 17 08:40:18.731101 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 164/323] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:18 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:18.990261 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-976fa987-a789-4f7e-99d9-d9d83c2d79f0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:18.990856 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-976fa987-a789-4f7e-99d9-d9d83c2d79f0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:18.997597 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-976fa987-a789-4f7e-99d9-d9d83c2d79f0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:18.998090 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-976fa987-a789-4f7e-99d9-d9d83c2d79f0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:18.998524 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-976fa987-a789-4f7e-99d9-d9d83c2d79f0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:18.999233 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-976fa987-a789-4f7e-99d9-d9d83c2d79f0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:18.999721 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-976fa987-a789-4f7e-99d9-d9d83c2d79f0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:19.000140 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-976fa987-a789-4f7e-99d9-d9d83c2d79f0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:19.133479 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-976fa987-a789-4f7e-99d9-d9d83c2d79f0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:19.141366 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-976fa987-a789-4f7e-99d9-d9d83c2d79f0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1371 microversion: 2.1 time: 0.154904 Aug 17 08:40:19.141924 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 160/324] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:18 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:19.414981 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8d235e24-e94f-407d-948f-06d4dc3e87f8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85b7c328-eda0-4fa8-9a23-49da8c5ec58a"}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:40:19.417409 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8d235e24-e94f-407d-948f-06d4dc3e87f8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:19.423907 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8d235e24-e94f-407d-948f-06d4dc3e87f8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:19.424384 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8d235e24-e94f-407d-948f-06d4dc3e87f8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:19.424822 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8d235e24-e94f-407d-948f-06d4dc3e87f8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:19.425497 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8d235e24-e94f-407d-948f-06d4dc3e87f8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:19.425972 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8d235e24-e94f-407d-948f-06d4dc3e87f8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:19.426392 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8d235e24-e94f-407d-948f-06d4dc3e87f8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:19.650342 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-67cd8d5c-0fca-4036-bd38-ec7f2bd3c3a1 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:19.650971 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-67cd8d5c-0fca-4036-bd38-ec7f2bd3c3a1 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: ce091a0c-0dc8-49aa-9ac6-d794a2dba74b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:19.657067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-67cd8d5c-0fca-4036-bd38-ec7f2bd3c3a1 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:19.657573 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-67cd8d5c-0fca-4036-bd38-ec7f2bd3c3a1 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:19.658003 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-67cd8d5c-0fca-4036-bd38-ec7f2bd3c3a1 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:19.658682 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-67cd8d5c-0fca-4036-bd38-ec7f2bd3c3a1 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:19.659131 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-67cd8d5c-0fca-4036-bd38-ec7f2bd3c3a1 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:19.659586 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-67cd8d5c-0fca-4036-bd38-ec7f2bd3c3a1 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:19.789142 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-67cd8d5c-0fca-4036-bd38-ec7f2bd3c3a1 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:19.796906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-67cd8d5c-0fca-4036-bd38-ec7f2bd3c3a1 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b" status: 200 len: 1319 microversion: 2.1 time: 0.150340 Aug 17 08:40:19.797464 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 161/325] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:19 2022] GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:40:19.801920 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-be3d70ed-93a0-4dde-a1d8-a72831b20fe8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:19.805392 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-be3d70ed-93a0-4dde-a1d8-a72831b20fe8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:19.811910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-be3d70ed-93a0-4dde-a1d8-a72831b20fe8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:19.812399 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-be3d70ed-93a0-4dde-a1d8-a72831b20fe8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:19.812833 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-be3d70ed-93a0-4dde-a1d8-a72831b20fe8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:19.813525 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-be3d70ed-93a0-4dde-a1d8-a72831b20fe8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:19.813970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-be3d70ed-93a0-4dde-a1d8-a72831b20fe8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:19.814386 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-be3d70ed-93a0-4dde-a1d8-a72831b20fe8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:19.969079 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-be3d70ed-93a0-4dde-a1d8-a72831b20fe8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:19.976797 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-be3d70ed-93a0-4dde-a1d8-a72831b20fe8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1260 microversion: 2.1 time: 0.178334 Aug 17 08:40:19.977368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 162/326] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:19 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:20.161942 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-fabbcac4-b8f3-47f2-924d-d147db0278e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:20.162539 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-fabbcac4-b8f3-47f2-924d-d147db0278e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:20.169433 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fabbcac4-b8f3-47f2-924d-d147db0278e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:20.170440 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fabbcac4-b8f3-47f2-924d-d147db0278e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:20.170876 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fabbcac4-b8f3-47f2-924d-d147db0278e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:20.171565 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fabbcac4-b8f3-47f2-924d-d147db0278e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:20.172028 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fabbcac4-b8f3-47f2-924d-d147db0278e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:20.172444 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fabbcac4-b8f3-47f2-924d-d147db0278e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:20.309762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-fabbcac4-b8f3-47f2-924d-d147db0278e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:20.323693 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-fabbcac4-b8f3-47f2-924d-d147db0278e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1371 microversion: 2.1 time: 0.165500 Aug 17 08:40:20.324270 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 163/327] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:20 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:40:20.406487 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8d235e24-e94f-407d-948f-06d4dc3e87f8 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "POST /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.995323 Aug 17 08:40:20.407123 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 165/328] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 08:40:19 2022] POST /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7/os-volume_attachments => generated 194 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:40:20.819421 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-7ef445f6-6044-4cdd-ba00-3f55dce5100e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:20.819985 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7ef445f6-6044-4cdd-ba00-3f55dce5100e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: ce091a0c-0dc8-49aa-9ac6-d794a2dba74b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:20.827586 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7ef445f6-6044-4cdd-ba00-3f55dce5100e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:20.828071 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7ef445f6-6044-4cdd-ba00-3f55dce5100e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:20.828496 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7ef445f6-6044-4cdd-ba00-3f55dce5100e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:20.829190 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7ef445f6-6044-4cdd-ba00-3f55dce5100e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:20.829637 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7ef445f6-6044-4cdd-ba00-3f55dce5100e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:20.830055 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7ef445f6-6044-4cdd-ba00-3f55dce5100e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:20.991949 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-7ef445f6-6044-4cdd-ba00-3f55dce5100e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:20.999085 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5a872b76-8367-4c8f-b452-e1e97152421c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:20.999894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-5a872b76-8367-4c8f-b452-e1e97152421c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:21.000086 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-7ef445f6-6044-4cdd-ba00-3f55dce5100e tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b" status: 200 len: 1319 microversion: 2.1 time: 0.185000 Aug 17 08:40:21.000657 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 164/329] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:20 2022] GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:21.006409 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5a872b76-8367-4c8f-b452-e1e97152421c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:21.006974 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5a872b76-8367-4c8f-b452-e1e97152421c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:21.007475 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5a872b76-8367-4c8f-b452-e1e97152421c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:21.008261 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5a872b76-8367-4c8f-b452-e1e97152421c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:21.008778 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5a872b76-8367-4c8f-b452-e1e97152421c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:21.009380 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5a872b76-8367-4c8f-b452-e1e97152421c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:21.152437 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-5a872b76-8367-4c8f-b452-e1e97152421c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:21.160092 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-5a872b76-8367-4c8f-b452-e1e97152421c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1260 microversion: 2.1 time: 0.166158 Aug 17 08:40:21.160714 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 166/330] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:20 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:40:21.346137 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a2600b97-41ae-4e05-857d-745ae07c76ca tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:21.346614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a2600b97-41ae-4e05-857d-745ae07c76ca tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:21.353032 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a2600b97-41ae-4e05-857d-745ae07c76ca tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:21.353514 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a2600b97-41ae-4e05-857d-745ae07c76ca tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:21.354044 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a2600b97-41ae-4e05-857d-745ae07c76ca tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:21.354846 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a2600b97-41ae-4e05-857d-745ae07c76ca tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:21.355356 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a2600b97-41ae-4e05-857d-745ae07c76ca tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:21.356184 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a2600b97-41ae-4e05-857d-745ae07c76ca tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:21.489442 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a2600b97-41ae-4e05-857d-745ae07c76ca tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:21.496919 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a2600b97-41ae-4e05-857d-745ae07c76ca tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1371 microversion: 2.1 time: 0.154796 Aug 17 08:40:21.497758 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 165/331] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:21 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:22.024628 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-745436ea-a43e-43c6-baf7-e3cf5ed95b85 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:22.025274 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-745436ea-a43e-43c6-baf7-e3cf5ed95b85 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: ce091a0c-0dc8-49aa-9ac6-d794a2dba74b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:22.032758 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-745436ea-a43e-43c6-baf7-e3cf5ed95b85 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:22.033246 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-745436ea-a43e-43c6-baf7-e3cf5ed95b85 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:22.033681 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-745436ea-a43e-43c6-baf7-e3cf5ed95b85 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:22.034721 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-745436ea-a43e-43c6-baf7-e3cf5ed95b85 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:22.035180 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-745436ea-a43e-43c6-baf7-e3cf5ed95b85 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:22.035627 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-745436ea-a43e-43c6-baf7-e3cf5ed95b85 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:22.169326 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-745436ea-a43e-43c6-baf7-e3cf5ed95b85 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:22.179089 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-745436ea-a43e-43c6-baf7-e3cf5ed95b85 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b" status: 200 len: 1507 microversion: 2.1 time: 0.158454 Aug 17 08:40:22.179901 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 167/332] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:22 2022] GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:22.180916 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f58f8452-6cef-4767-a63f-1d2a6eb69fb0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:22.182778 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f58f8452-6cef-4767-a63f-1d2a6eb69fb0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:22.190212 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f58f8452-6cef-4767-a63f-1d2a6eb69fb0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:22.191093 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f58f8452-6cef-4767-a63f-1d2a6eb69fb0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:22.191829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f58f8452-6cef-4767-a63f-1d2a6eb69fb0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:22.193592 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f58f8452-6cef-4767-a63f-1d2a6eb69fb0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:22.194232 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f58f8452-6cef-4767-a63f-1d2a6eb69fb0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:22.194934 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f58f8452-6cef-4767-a63f-1d2a6eb69fb0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:22.337863 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f58f8452-6cef-4767-a63f-1d2a6eb69fb0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:22.345889 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f58f8452-6cef-4767-a63f-1d2a6eb69fb0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1260 microversion: 2.1 time: 0.169066 Aug 17 08:40:22.360646 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 166/333] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:22 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:40:22.505800 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-c811cd78-3f1e-42be-b5a9-3125aa83be7b req-d95f5489-ca7f-4f9b-b880-cc3fe7bebf55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe1b2a32-cde6-43da-885e-78a42a55a7f1", "name": "network-vif-plugged", "status": "completed", "tag": "26fa0a6d-8a86-40e7-a48f-d1b7d96cfcfb"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:40:22.518815 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-c811cd78-3f1e-42be-b5a9-3125aa83be7b req-d95f5489-ca7f-4f9b-b880-cc3fe7bebf55 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:22.519455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-c811cd78-3f1e-42be-b5a9-3125aa83be7b req-d95f5489-ca7f-4f9b-b880-cc3fe7bebf55 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:22.519729 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b0832fc3-a384-4239-a36b-88e455888ab8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:22.520063 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-c811cd78-3f1e-42be-b5a9-3125aa83be7b req-d95f5489-ca7f-4f9b-b880-cc3fe7bebf55 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:22.520802 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b0832fc3-a384-4239-a36b-88e455888ab8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:22.536095 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-c811cd78-3f1e-42be-b5a9-3125aa83be7b req-d95f5489-ca7f-4f9b-b880-cc3fe7bebf55 service nova] Creating event network-vif-plugged:26fa0a6d-8a86-40e7-a48f-d1b7d96cfcfb for instance fe1b2a32-cde6-43da-885e-78a42a55a7f1 on hv-cinder-85331 Aug 17 08:40:22.545678 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-c811cd78-3f1e-42be-b5a9-3125aa83be7b req-d95f5489-ca7f-4f9b-b880-cc3fe7bebf55 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043684 Aug 17 08:40:22.546849 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 168/334] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:40:22.554153 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b0832fc3-a384-4239-a36b-88e455888ab8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:22.554703 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b0832fc3-a384-4239-a36b-88e455888ab8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:22.555180 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b0832fc3-a384-4239-a36b-88e455888ab8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:22.555952 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b0832fc3-a384-4239-a36b-88e455888ab8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:22.556403 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b0832fc3-a384-4239-a36b-88e455888ab8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:22.556829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b0832fc3-a384-4239-a36b-88e455888ab8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:22.763832 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b0832fc3-a384-4239-a36b-88e455888ab8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:22.771613 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b0832fc3-a384-4239-a36b-88e455888ab8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1371 microversion: 2.1 time: 0.256936 Aug 17 08:40:22.772214 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 167/335] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:22 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1371 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:23.369565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e9fb6945-7ba9-4b5d-85e2-75e15f037353 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:23.370239 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e9fb6945-7ba9-4b5d-85e2-75e15f037353 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:23.373423 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=8 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:23.374231 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=30 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:23.381431 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9fb6945-7ba9-4b5d-85e2-75e15f037353 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:23.381910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9fb6945-7ba9-4b5d-85e2-75e15f037353 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:23.382362 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9fb6945-7ba9-4b5d-85e2-75e15f037353 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:23.383178 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9fb6945-7ba9-4b5d-85e2-75e15f037353 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:23.385095 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9fb6945-7ba9-4b5d-85e2-75e15f037353 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:23.385095 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9fb6945-7ba9-4b5d-85e2-75e15f037353 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:23.520429 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e9fb6945-7ba9-4b5d-85e2-75e15f037353 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:23.528333 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e9fb6945-7ba9-4b5d-85e2-75e15f037353 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1260 microversion: 2.1 time: 0.162743 Aug 17 08:40:23.528989 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 169/336] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:23 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:23.793795 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-56f84bfa-6628-4122-b1bb-a2740f2548c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:23.794366 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-56f84bfa-6628-4122-b1bb-a2740f2548c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:23.801740 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-56f84bfa-6628-4122-b1bb-a2740f2548c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:23.802218 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-56f84bfa-6628-4122-b1bb-a2740f2548c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:23.802659 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-56f84bfa-6628-4122-b1bb-a2740f2548c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:23.803367 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-56f84bfa-6628-4122-b1bb-a2740f2548c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:23.803868 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-56f84bfa-6628-4122-b1bb-a2740f2548c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:23.804293 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-56f84bfa-6628-4122-b1bb-a2740f2548c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:23.933757 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-56f84bfa-6628-4122-b1bb-a2740f2548c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:23.942045 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-56f84bfa-6628-4122-b1bb-a2740f2548c1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1371 microversion: 2.1 time: 0.152714 Aug 17 08:40:23.942616 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 168/337] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:23 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:24.548720 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-02ffd7ac-5d7d-43bb-94ac-11e18200c5f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:24.549331 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-02ffd7ac-5d7d-43bb-94ac-11e18200c5f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:24.556937 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-02ffd7ac-5d7d-43bb-94ac-11e18200c5f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:24.557455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-02ffd7ac-5d7d-43bb-94ac-11e18200c5f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:24.557870 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-02ffd7ac-5d7d-43bb-94ac-11e18200c5f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:24.558550 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-02ffd7ac-5d7d-43bb-94ac-11e18200c5f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:24.558999 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-02ffd7ac-5d7d-43bb-94ac-11e18200c5f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:24.559425 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-02ffd7ac-5d7d-43bb-94ac-11e18200c5f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:24.561440 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-9807350f-e1e9-4c9b-8e07-adacbf267f31 req-ebcb24f4-3e4e-4583-9621-c5e3d963ce91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1", "name": "network-vif-plugged", "status": "completed", "tag": "07a04b7d-775b-4a78-95c5-7fe56d001b03"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:40:24.571168 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-9807350f-e1e9-4c9b-8e07-adacbf267f31 req-ebcb24f4-3e4e-4583-9621-c5e3d963ce91 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:24.571773 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-9807350f-e1e9-4c9b-8e07-adacbf267f31 req-ebcb24f4-3e4e-4583-9621-c5e3d963ce91 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:24.572278 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-9807350f-e1e9-4c9b-8e07-adacbf267f31 req-ebcb24f4-3e4e-4583-9621-c5e3d963ce91 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:24.583691 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-9807350f-e1e9-4c9b-8e07-adacbf267f31 req-ebcb24f4-3e4e-4583-9621-c5e3d963ce91 service nova] Creating event network-vif-plugged:07a04b7d-775b-4a78-95c5-7fe56d001b03 for instance 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 on hv-cinder-85331 Aug 17 08:40:24.588779 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-9807350f-e1e9-4c9b-8e07-adacbf267f31 req-ebcb24f4-3e4e-4583-9621-c5e3d963ce91 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031587 Aug 17 08:40:24.589456 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 169/338] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:40:24.702890 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-02ffd7ac-5d7d-43bb-94ac-11e18200c5f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:24.710855 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-02ffd7ac-5d7d-43bb-94ac-11e18200c5f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1444 microversion: 2.1 time: 0.166008 Aug 17 08:40:24.711435 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 170/339] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:24 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1444 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:24.732074 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0b419aa3-250f-4bfe-aed7-8553294aeb48 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:24.732768 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0b419aa3-250f-4bfe-aed7-8553294aeb48 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:24.739206 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0b419aa3-250f-4bfe-aed7-8553294aeb48 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:24.739590 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0b419aa3-250f-4bfe-aed7-8553294aeb48 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:24.740023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0b419aa3-250f-4bfe-aed7-8553294aeb48 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:24.740711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0b419aa3-250f-4bfe-aed7-8553294aeb48 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:24.741186 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0b419aa3-250f-4bfe-aed7-8553294aeb48 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:24.741603 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0b419aa3-250f-4bfe-aed7-8553294aeb48 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:24.877392 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0b419aa3-250f-4bfe-aed7-8553294aeb48 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:24.884827 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0b419aa3-250f-4bfe-aed7-8553294aeb48 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1444 microversion: 2.1 time: 0.157100 Aug 17 08:40:24.885387 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 170/340] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:24 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:24.963087 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6b7e675f-15d8-423e-b1a4-d39264fd68be tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:24.963721 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6b7e675f-15d8-423e-b1a4-d39264fd68be tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:24.969563 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6b7e675f-15d8-423e-b1a4-d39264fd68be tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:24.970044 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6b7e675f-15d8-423e-b1a4-d39264fd68be tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:24.970473 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6b7e675f-15d8-423e-b1a4-d39264fd68be tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:24.971149 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6b7e675f-15d8-423e-b1a4-d39264fd68be tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:24.971618 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6b7e675f-15d8-423e-b1a4-d39264fd68be tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:24.972046 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6b7e675f-15d8-423e-b1a4-d39264fd68be tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:25.112952 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6b7e675f-15d8-423e-b1a4-d39264fd68be tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:25.120441 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6b7e675f-15d8-423e-b1a4-d39264fd68be tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1371 microversion: 2.1 time: 0.161193 Aug 17 08:40:25.121908 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 171/341] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:24 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:26.144434 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1642e492-268e-4e38-af23-33ca51ebb2ab tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:26.145030 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1642e492-268e-4e38-af23-33ca51ebb2ab tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:26.151458 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1642e492-268e-4e38-af23-33ca51ebb2ab tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:26.151961 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1642e492-268e-4e38-af23-33ca51ebb2ab tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:26.152388 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1642e492-268e-4e38-af23-33ca51ebb2ab tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:26.153061 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1642e492-268e-4e38-af23-33ca51ebb2ab tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:26.153504 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1642e492-268e-4e38-af23-33ca51ebb2ab tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:26.153916 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1642e492-268e-4e38-af23-33ca51ebb2ab tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:26.379012 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1642e492-268e-4e38-af23-33ca51ebb2ab tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:26.386465 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1642e492-268e-4e38-af23-33ca51ebb2ab tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1371 microversion: 2.1 time: 0.245881 Aug 17 08:40:26.387026 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 171/342] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:26 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:26.742993 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-6b8e6bba-97ea-45cd-9671-b07b4e561f4f req-904d12b1-255e-4a5e-a3a3-4b73c0ac495e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe1b2a32-cde6-43da-885e-78a42a55a7f1", "tag": "26fa0a6d-8a86-40e7-a48f-d1b7d96cfcfb"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:40:26.754359 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-6b8e6bba-97ea-45cd-9671-b07b4e561f4f req-904d12b1-255e-4a5e-a3a3-4b73c0ac495e service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:26.754957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-6b8e6bba-97ea-45cd-9671-b07b4e561f4f req-904d12b1-255e-4a5e-a3a3-4b73c0ac495e service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:26.755449 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-6b8e6bba-97ea-45cd-9671-b07b4e561f4f req-904d12b1-255e-4a5e-a3a3-4b73c0ac495e service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:26.767285 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-6b8e6bba-97ea-45cd-9671-b07b4e561f4f req-904d12b1-255e-4a5e-a3a3-4b73c0ac495e service nova] Creating event network-changed:26fa0a6d-8a86-40e7-a48f-d1b7d96cfcfb for instance fe1b2a32-cde6-43da-885e-78a42a55a7f1 on hv-cinder-85331 Aug 17 08:40:26.772584 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-6b8e6bba-97ea-45cd-9671-b07b4e561f4f req-904d12b1-255e-4a5e-a3a3-4b73c0ac495e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033553 Aug 17 08:40:26.773598 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 172/343] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:40:27.410677 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-478d18ef-419d-436f-8b83-d5f0ad9c8d73 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:27.411786 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-478d18ef-419d-436f-8b83-d5f0ad9c8d73 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:27.419145 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-478d18ef-419d-436f-8b83-d5f0ad9c8d73 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:27.420158 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-478d18ef-419d-436f-8b83-d5f0ad9c8d73 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:27.420582 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-478d18ef-419d-436f-8b83-d5f0ad9c8d73 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:27.421262 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-478d18ef-419d-436f-8b83-d5f0ad9c8d73 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:27.421709 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-478d18ef-419d-436f-8b83-d5f0ad9c8d73 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:27.422121 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-478d18ef-419d-436f-8b83-d5f0ad9c8d73 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:27.559394 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:27.590397 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-478d18ef-419d-436f-8b83-d5f0ad9c8d73 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:27.600181 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-478d18ef-419d-436f-8b83-d5f0ad9c8d73 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1371 microversion: 2.1 time: 0.195783 Aug 17 08:40:27.600900 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 172/344] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:27 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:40:28.622615 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-83637c86-aa4c-4d21-8be0-3c74042dad64 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:28.623336 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-83637c86-aa4c-4d21-8be0-3c74042dad64 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:28.629419 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-83637c86-aa4c-4d21-8be0-3c74042dad64 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:28.629898 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-83637c86-aa4c-4d21-8be0-3c74042dad64 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:28.630332 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-83637c86-aa4c-4d21-8be0-3c74042dad64 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:28.631008 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-83637c86-aa4c-4d21-8be0-3c74042dad64 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:28.631458 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-83637c86-aa4c-4d21-8be0-3c74042dad64 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:28.631909 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-83637c86-aa4c-4d21-8be0-3c74042dad64 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:28.646302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:28.765020 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-83637c86-aa4c-4d21-8be0-3c74042dad64 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:28.772666 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-83637c86-aa4c-4d21-8be0-3c74042dad64 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1565 microversion: 2.1 time: 0.154876 Aug 17 08:40:28.773224 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 173/345] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:28 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:28.794632 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-30c86829-d8fb-4373-8abb-41ba6b73aa23 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:28.795789 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-30c86829-d8fb-4373-8abb-41ba6b73aa23 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:28.802150 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-30c86829-d8fb-4373-8abb-41ba6b73aa23 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:28.802627 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-30c86829-d8fb-4373-8abb-41ba6b73aa23 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:28.803061 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-30c86829-d8fb-4373-8abb-41ba6b73aa23 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:28.803773 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-30c86829-d8fb-4373-8abb-41ba6b73aa23 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:28.804250 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-30c86829-d8fb-4373-8abb-41ba6b73aa23 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:28.804667 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-30c86829-d8fb-4373-8abb-41ba6b73aa23 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:28.880357 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-30c86829-d8fb-4373-8abb-41ba6b73aa23 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089470 Aug 17 08:40:28.880959 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 173/346] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 17 08:40:28 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:40:30.175257 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-622861ac-8fd9-4a02-acb6-eef9e590e846 req-44bf8ef1-7642-409b-823f-95e3fd0975e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1", "tag": "07a04b7d-775b-4a78-95c5-7fe56d001b03"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:40:30.185077 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-622861ac-8fd9-4a02-acb6-eef9e590e846 req-44bf8ef1-7642-409b-823f-95e3fd0975e2 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:30.185589 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-622861ac-8fd9-4a02-acb6-eef9e590e846 req-44bf8ef1-7642-409b-823f-95e3fd0975e2 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:30.186014 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-622861ac-8fd9-4a02-acb6-eef9e590e846 req-44bf8ef1-7642-409b-823f-95e3fd0975e2 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:30.199167 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-622861ac-8fd9-4a02-acb6-eef9e590e846 req-44bf8ef1-7642-409b-823f-95e3fd0975e2 service nova] Creating event network-changed:07a04b7d-775b-4a78-95c5-7fe56d001b03 for instance 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 on hv-cinder-85331 Aug 17 08:40:30.205866 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-622861ac-8fd9-4a02-acb6-eef9e590e846 req-44bf8ef1-7642-409b-823f-95e3fd0975e2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034421 Aug 17 08:40:30.210567 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 174/347] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:40:30.251553 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b197643a-d690-42ae-ab1f-4b42b3253988 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:30.252185 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b197643a-d690-42ae-ab1f-4b42b3253988 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:30.258413 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b197643a-d690-42ae-ab1f-4b42b3253988 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:30.258837 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b197643a-d690-42ae-ab1f-4b42b3253988 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:30.259265 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b197643a-d690-42ae-ab1f-4b42b3253988 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:30.259988 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b197643a-d690-42ae-ab1f-4b42b3253988 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:30.260441 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b197643a-d690-42ae-ab1f-4b42b3253988 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:30.260853 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b197643a-d690-42ae-ab1f-4b42b3253988 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:30.414162 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b197643a-d690-42ae-ab1f-4b42b3253988 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:30.429916 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b197643a-d690-42ae-ab1f-4b42b3253988 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1593 microversion: 2.1 time: 0.182729 Aug 17 08:40:30.444478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 174/348] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:30 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1593 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:32.221287 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-d41824d5-9863-4b5f-8b57-0c395b55e06d req-9ecbf473-0e73-4b8e-a11e-f46bb2578d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92675ce7-75fe-4b8e-afae-d1940474e4b7", "tag": "9f364177-8ecc-4da1-86aa-209bcf11e8dc"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:40:32.231662 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-d41824d5-9863-4b5f-8b57-0c395b55e06d req-9ecbf473-0e73-4b8e-a11e-f46bb2578d96 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:32.232140 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-d41824d5-9863-4b5f-8b57-0c395b55e06d req-9ecbf473-0e73-4b8e-a11e-f46bb2578d96 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:32.232565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-d41824d5-9863-4b5f-8b57-0c395b55e06d req-9ecbf473-0e73-4b8e-a11e-f46bb2578d96 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:32.251713 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-d41824d5-9863-4b5f-8b57-0c395b55e06d req-9ecbf473-0e73-4b8e-a11e-f46bb2578d96 service nova] Creating event network-changed:9f364177-8ecc-4da1-86aa-209bcf11e8dc for instance 92675ce7-75fe-4b8e-afae-d1940474e4b7 on hv-cinder-85331 Aug 17 08:40:32.251713 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-d41824d5-9863-4b5f-8b57-0c395b55e06d req-9ecbf473-0e73-4b8e-a11e-f46bb2578d96 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033943 Aug 17 08:40:32.253819 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 175/349] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:40:33.324327 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-89fbf9d9-946d-498d-8cc6-f692aa04cfa7 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1951761595"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:40:33.324881 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-89fbf9d9-946d-498d-8cc6-f692aa04cfa7 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:33.332039 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-89fbf9d9-946d-498d-8cc6-f692aa04cfa7 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:33.332524 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-89fbf9d9-946d-498d-8cc6-f692aa04cfa7 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:33.332957 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-89fbf9d9-946d-498d-8cc6-f692aa04cfa7 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:33.333641 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-89fbf9d9-946d-498d-8cc6-f692aa04cfa7 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:33.334093 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-89fbf9d9-946d-498d-8cc6-f692aa04cfa7 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:33.334508 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-89fbf9d9-946d-498d-8cc6-f692aa04cfa7 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:33.470467 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.network.security_group_api [None req-89fbf9d9-946d-498d-8cc6-f692aa04cfa7 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Adding security group 11cbc0ed-1328-46fb-9e40-c4aa41c3ace0 to port 9f364177-8ecc-4da1-86aa-209bcf11e8dc Aug 17 08:40:33.789334 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-89fbf9d9-946d-498d-8cc6-f692aa04cfa7 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "POST /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7/action" status: 202 len: 0 microversion: 2.1 time: 0.469262 Aug 17 08:40:33.790031 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 175/350] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 08:40:33 2022] POST /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:40:33.798524 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2896b013-39da-4a13-92bb-7f862cbd534c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:40:33.799210 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-2896b013-39da-4a13-92bb-7f862cbd534c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:33.806296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2896b013-39da-4a13-92bb-7f862cbd534c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:33.806773 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2896b013-39da-4a13-92bb-7f862cbd534c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:33.807202 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2896b013-39da-4a13-92bb-7f862cbd534c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:33.807911 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2896b013-39da-4a13-92bb-7f862cbd534c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:33.808358 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2896b013-39da-4a13-92bb-7f862cbd534c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:33.808775 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2896b013-39da-4a13-92bb-7f862cbd534c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:33.963963 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-2896b013-39da-4a13-92bb-7f862cbd534c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:40:33.972760 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2896b013-39da-4a13-92bb-7f862cbd534c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1758 microversion: 2.1 time: 0.178379 Aug 17 08:40:33.973336 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 176/351] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:40:33 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:40:34.268585 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-c9e7cf11-63d8-4355-a555-a9d6b1a6cefb req-689e1334-c3c1-4958-9776-e98c36a4ce41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92675ce7-75fe-4b8e-afae-d1940474e4b7", "tag": "9f364177-8ecc-4da1-86aa-209bcf11e8dc"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:40:34.279009 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-c9e7cf11-63d8-4355-a555-a9d6b1a6cefb req-689e1334-c3c1-4958-9776-e98c36a4ce41 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:34.279586 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-c9e7cf11-63d8-4355-a555-a9d6b1a6cefb req-689e1334-c3c1-4958-9776-e98c36a4ce41 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:34.280214 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-c9e7cf11-63d8-4355-a555-a9d6b1a6cefb req-689e1334-c3c1-4958-9776-e98c36a4ce41 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:34.291469 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-c9e7cf11-63d8-4355-a555-a9d6b1a6cefb req-689e1334-c3c1-4958-9776-e98c36a4ce41 service nova] Creating event network-changed:9f364177-8ecc-4da1-86aa-209bcf11e8dc for instance 92675ce7-75fe-4b8e-afae-d1940474e4b7 on hv-cinder-85331 Aug 17 08:40:34.296861 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-c9e7cf11-63d8-4355-a555-a9d6b1a6cefb req-689e1334-c3c1-4958-9776-e98c36a4ce41 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031880 Aug 17 08:40:34.297778 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 176/352] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:40:54.362140 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1bd1114e-933b-4d4c-8367-b317444b1b9d tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e72ed67f-37f9-4c49-a1a7-1c537d7283cb", "device": "/dev/sdb"}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:40:54.365048 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1bd1114e-933b-4d4c-8367-b317444b1b9d tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: ce091a0c-0dc8-49aa-9ac6-d794a2dba74b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:40:54.367995 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:54.368252 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=13 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:40:54.374493 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1bd1114e-933b-4d4c-8367-b317444b1b9d tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:54.374971 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1bd1114e-933b-4d4c-8367-b317444b1b9d tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:54.375404 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1bd1114e-933b-4d4c-8367-b317444b1b9d tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:54.376114 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1bd1114e-933b-4d4c-8367-b317444b1b9d tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:40:54.376561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1bd1114e-933b-4d4c-8367-b317444b1b9d tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:40:54.376977 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1bd1114e-933b-4d4c-8367-b317444b1b9d tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:40:54.777291 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1bd1114e-933b-4d4c-8367-b317444b1b9d tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "POST /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.418638 Aug 17 08:40:54.778455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 177/353] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 08:40:54 2022] POST /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b/os-volume_attachments => generated 194 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:41:14.253817 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=53 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:41:14.254542 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=98 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:41:14.259312 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c49da04d-c2db-4ed3-b6d7-dfc8d05d5a0f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:14.260014 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c49da04d-c2db-4ed3-b6d7-dfc8d05d5a0f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:14.266999 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c49da04d-c2db-4ed3-b6d7-dfc8d05d5a0f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:14.267470 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c49da04d-c2db-4ed3-b6d7-dfc8d05d5a0f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:14.267934 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c49da04d-c2db-4ed3-b6d7-dfc8d05d5a0f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:14.268601 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c49da04d-c2db-4ed3-b6d7-dfc8d05d5a0f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:14.269047 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c49da04d-c2db-4ed3-b6d7-dfc8d05d5a0f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:14.269557 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c49da04d-c2db-4ed3-b6d7-dfc8d05d5a0f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:14.395294 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-c49da04d-c2db-4ed3-b6d7-dfc8d05d5a0f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lazy-loading 'services' on Instance uuid c224c091-7aa6-49a0-b269-a833010f6cc9 {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:41:14.508934 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c49da04d-c2db-4ed3-b6d7-dfc8d05d5a0f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9/os-volume_attachments/85876e99-fe2d-4eae-bef3-3376c95acbe7" status: 202 len: 0 microversion: 2.1 time: 0.256657 Aug 17 08:41:14.509692 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 177/354] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 08:41:14 2022] DELETE /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9/os-volume_attachments/85876e99-fe2d-4eae-bef3-3376c95acbe7 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:41:16.681567 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:41:16.682507 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:41:16.686632 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-39cb704a-8c1f-4040-8abb-0c966febf155 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:41:16.694089 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-39cb704a-8c1f-4040-8abb-0c966febf155 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:16.694561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-39cb704a-8c1f-4040-8abb-0c966febf155 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:16.694993 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-39cb704a-8c1f-4040-8abb-0c966febf155 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:16.717188 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-39cb704a-8c1f-4040-8abb-0c966febf155 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Going to try to stop instance {{(pid=127297) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 17 08:41:16.757525 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-39cb704a-8c1f-4040-8abb-0c966febf155 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "POST /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9/action" status: 202 len: 0 microversion: 2.1 time: 0.077181 Aug 17 08:41:16.758110 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 178/355] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 08:41:16 2022] POST /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:41:16.768492 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-71bf84b1-d36d-4cf4-ac84-57c98c0a875f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:16.769325 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-71bf84b1-d36d-4cf4-ac84-57c98c0a875f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:16.776667 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-71bf84b1-d36d-4cf4-ac84-57c98c0a875f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:16.777198 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-71bf84b1-d36d-4cf4-ac84-57c98c0a875f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:16.777633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-71bf84b1-d36d-4cf4-ac84-57c98c0a875f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:16.778459 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-71bf84b1-d36d-4cf4-ac84-57c98c0a875f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:16.779559 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-71bf84b1-d36d-4cf4-ac84-57c98c0a875f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:16.780007 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-71bf84b1-d36d-4cf4-ac84-57c98c0a875f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:16.913853 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-71bf84b1-d36d-4cf4-ac84-57c98c0a875f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:16.921691 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-71bf84b1-d36d-4cf4-ac84-57c98c0a875f tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1677 microversion: 2.1 time: 0.158369 Aug 17 08:41:16.922266 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 178/356] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:16 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:17.415914 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 08:41:17.416123 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Wed Aug 17 08:41:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 08:41:17.943098 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-63d8a42c-8ca2-49ce-84b8-84b7aa4ecea4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:17.943831 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-63d8a42c-8ca2-49ce-84b8-84b7aa4ecea4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:17.949867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-63d8a42c-8ca2-49ce-84b8-84b7aa4ecea4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:17.950336 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-63d8a42c-8ca2-49ce-84b8-84b7aa4ecea4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:17.950759 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-63d8a42c-8ca2-49ce-84b8-84b7aa4ecea4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:17.951438 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-63d8a42c-8ca2-49ce-84b8-84b7aa4ecea4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:17.951907 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-63d8a42c-8ca2-49ce-84b8-84b7aa4ecea4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:17.952458 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-63d8a42c-8ca2-49ce-84b8-84b7aa4ecea4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:18.077904 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-63d8a42c-8ca2-49ce-84b8-84b7aa4ecea4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:18.085779 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-63d8a42c-8ca2-49ce-84b8-84b7aa4ecea4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1677 microversion: 2.1 time: 0.147254 Aug 17 08:41:18.086349 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 179/357] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:17 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:18.429880 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1c331578-4ed2-4e4e-971d-f7451a6e8b82 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:18.430355 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1c331578-4ed2-4e4e-971d-f7451a6e8b82 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: ce091a0c-0dc8-49aa-9ac6-d794a2dba74b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:18.436711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1c331578-4ed2-4e4e-971d-f7451a6e8b82 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:18.437184 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1c331578-4ed2-4e4e-971d-f7451a6e8b82 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:18.437609 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1c331578-4ed2-4e4e-971d-f7451a6e8b82 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:18.438284 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1c331578-4ed2-4e4e-971d-f7451a6e8b82 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:18.438732 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1c331578-4ed2-4e4e-971d-f7451a6e8b82 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:18.439148 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1c331578-4ed2-4e4e-971d-f7451a6e8b82 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:18.522353 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-1c331578-4ed2-4e4e-971d-f7451a6e8b82 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lazy-loading 'services' on Instance uuid ce091a0c-0dc8-49aa-9ac6-d794a2dba74b {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:41:18.594166 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1c331578-4ed2-4e4e-971d-f7451a6e8b82 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b/os-volume_attachments/e72ed67f-37f9-4c49-a1a7-1c537d7283cb" status: 202 len: 0 microversion: 2.1 time: 0.168054 Aug 17 08:41:18.594745 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 179/358] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 08:41:18 2022] DELETE /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b/os-volume_attachments/e72ed67f-37f9-4c49-a1a7-1c537d7283cb => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:41:19.107357 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-271b44f3-1bd3-4d5f-bf51-035dacdbbc25 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:19.107939 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-271b44f3-1bd3-4d5f-bf51-035dacdbbc25 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:19.114225 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-271b44f3-1bd3-4d5f-bf51-035dacdbbc25 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:19.114694 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-271b44f3-1bd3-4d5f-bf51-035dacdbbc25 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:19.115120 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-271b44f3-1bd3-4d5f-bf51-035dacdbbc25 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:19.115847 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-271b44f3-1bd3-4d5f-bf51-035dacdbbc25 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:19.116289 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-271b44f3-1bd3-4d5f-bf51-035dacdbbc25 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:19.116701 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-271b44f3-1bd3-4d5f-bf51-035dacdbbc25 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:19.250524 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-271b44f3-1bd3-4d5f-bf51-035dacdbbc25 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:19.257891 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-271b44f3-1bd3-4d5f-bf51-035dacdbbc25 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1677 microversion: 2.1 time: 0.155078 Aug 17 08:41:19.258446 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 180/359] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:19 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:41:19.727447 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-69937258-11bb-4b7c-bbfb-f95cebf2f036 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:19.728053 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-69937258-11bb-4b7c-bbfb-f95cebf2f036 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: ce091a0c-0dc8-49aa-9ac6-d794a2dba74b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:19.735223 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-69937258-11bb-4b7c-bbfb-f95cebf2f036 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:19.735737 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-69937258-11bb-4b7c-bbfb-f95cebf2f036 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:19.736168 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-69937258-11bb-4b7c-bbfb-f95cebf2f036 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:19.736847 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-69937258-11bb-4b7c-bbfb-f95cebf2f036 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:19.737291 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-69937258-11bb-4b7c-bbfb-f95cebf2f036 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:19.737887 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-69937258-11bb-4b7c-bbfb-f95cebf2f036 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:19.762559 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-69937258-11bb-4b7c-bbfb-f95cebf2f036 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: ce091a0c-0dc8-49aa-9ac6-d794a2dba74b] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 08:41:19.833767 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-69937258-11bb-4b7c-bbfb-f95cebf2f036 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b" status: 204 len: 0 microversion: 2.1 time: 0.110207 Aug 17 08:41:19.834539 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 180/360] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:41:19 2022] DELETE /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 08:41:19.843170 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3d9108df-f5a8-40c1-acc0-e174a121c226 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:19.843821 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3d9108df-f5a8-40c1-acc0-e174a121c226 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: ce091a0c-0dc8-49aa-9ac6-d794a2dba74b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:19.849846 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d9108df-f5a8-40c1-acc0-e174a121c226 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:19.850320 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d9108df-f5a8-40c1-acc0-e174a121c226 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:19.850748 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d9108df-f5a8-40c1-acc0-e174a121c226 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:19.851421 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d9108df-f5a8-40c1-acc0-e174a121c226 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:19.851890 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d9108df-f5a8-40c1-acc0-e174a121c226 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:19.852305 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d9108df-f5a8-40c1-acc0-e174a121c226 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:19.976949 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3d9108df-f5a8-40c1-acc0-e174a121c226 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:19.985190 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3d9108df-f5a8-40c1-acc0-e174a121c226 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b" status: 200 len: 1513 microversion: 2.1 time: 0.146508 Aug 17 08:41:19.985762 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 181/361] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:19 2022] GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:20.278887 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-232d0ade-201f-4c6c-8a40-623e8511e2e4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:20.279498 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-232d0ade-201f-4c6c-8a40-623e8511e2e4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:20.285348 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-232d0ade-201f-4c6c-8a40-623e8511e2e4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:20.285826 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-232d0ade-201f-4c6c-8a40-623e8511e2e4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:20.286258 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-232d0ade-201f-4c6c-8a40-623e8511e2e4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:20.286931 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-232d0ade-201f-4c6c-8a40-623e8511e2e4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:20.287377 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-232d0ade-201f-4c6c-8a40-623e8511e2e4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:20.287821 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-232d0ade-201f-4c6c-8a40-623e8511e2e4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:20.414177 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-232d0ade-201f-4c6c-8a40-623e8511e2e4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:20.421588 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-232d0ade-201f-4c6c-8a40-623e8511e2e4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1677 microversion: 2.1 time: 0.147010 Aug 17 08:41:20.422150 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 181/362] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:20 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:21.006136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-74eac94a-5827-47c4-94df-8a886cedeb04 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:21.006735 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-74eac94a-5827-47c4-94df-8a886cedeb04 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: ce091a0c-0dc8-49aa-9ac6-d794a2dba74b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:21.013047 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-74eac94a-5827-47c4-94df-8a886cedeb04 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:21.013517 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-74eac94a-5827-47c4-94df-8a886cedeb04 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:21.013939 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-74eac94a-5827-47c4-94df-8a886cedeb04 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:21.014610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-74eac94a-5827-47c4-94df-8a886cedeb04 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:21.015054 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-74eac94a-5827-47c4-94df-8a886cedeb04 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:21.015469 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-74eac94a-5827-47c4-94df-8a886cedeb04 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:21.146579 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-74eac94a-5827-47c4-94df-8a886cedeb04 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:21.154514 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-74eac94a-5827-47c4-94df-8a886cedeb04 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b" status: 200 len: 1513 microversion: 2.1 time: 0.152380 Aug 17 08:41:21.155079 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 182/363] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:21 2022] GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:21.441969 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c49b17ad-475d-40db-a940-641b51723617 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:21.442679 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c49b17ad-475d-40db-a940-641b51723617 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:21.448989 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c49b17ad-475d-40db-a940-641b51723617 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:21.449465 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c49b17ad-475d-40db-a940-641b51723617 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:21.449892 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c49b17ad-475d-40db-a940-641b51723617 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:21.450571 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c49b17ad-475d-40db-a940-641b51723617 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:21.451036 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c49b17ad-475d-40db-a940-641b51723617 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:21.451449 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c49b17ad-475d-40db-a940-641b51723617 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:21.578405 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c49b17ad-475d-40db-a940-641b51723617 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:21.586145 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c49b17ad-475d-40db-a940-641b51723617 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1677 microversion: 2.1 time: 0.147978 Aug 17 08:41:21.586695 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 182/364] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:21 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:22.175828 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7164a52b-51d7-4ba6-a76d-00096a585489 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:22.176426 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7164a52b-51d7-4ba6-a76d-00096a585489 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: ce091a0c-0dc8-49aa-9ac6-d794a2dba74b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:22.182658 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7164a52b-51d7-4ba6-a76d-00096a585489 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:22.183132 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7164a52b-51d7-4ba6-a76d-00096a585489 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:22.183578 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7164a52b-51d7-4ba6-a76d-00096a585489 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:22.184258 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7164a52b-51d7-4ba6-a76d-00096a585489 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:22.185340 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7164a52b-51d7-4ba6-a76d-00096a585489 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:22.185772 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7164a52b-51d7-4ba6-a76d-00096a585489 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:22.397676 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-7164a52b-51d7-4ba6-a76d-00096a585489 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:22.406431 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-7164a52b-51d7-4ba6-a76d-00096a585489 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b" status: 200 len: 1513 microversion: 2.1 time: 0.234449 Aug 17 08:41:22.407035 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 183/365] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:22 2022] GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b => generated 1513 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:22.567303 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-51d99ab6-3350-49df-a660-428131c4a600 req-b5dbc69d-415a-4693-b519-ac7d0481db29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce091a0c-0dc8-49aa-9ac6-d794a2dba74b", "name": "network-vif-deleted", "tag": "2c55b1fd-8986-45a0-ada6-fcef2d4bd388"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:41:22.578231 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-51d99ab6-3350-49df-a660-428131c4a600 req-b5dbc69d-415a-4693-b519-ac7d0481db29 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:22.578697 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-51d99ab6-3350-49df-a660-428131c4a600 req-b5dbc69d-415a-4693-b519-ac7d0481db29 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:22.579114 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-51d99ab6-3350-49df-a660-428131c4a600 req-b5dbc69d-415a-4693-b519-ac7d0481db29 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:22.592193 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-51d99ab6-3350-49df-a660-428131c4a600 req-b5dbc69d-415a-4693-b519-ac7d0481db29 service nova] Creating event network-vif-deleted:2c55b1fd-8986-45a0-ada6-fcef2d4bd388 for instance ce091a0c-0dc8-49aa-9ac6-d794a2dba74b on hv-cinder-85331 Aug 17 08:41:22.599806 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-51d99ab6-3350-49df-a660-428131c4a600 req-b5dbc69d-415a-4693-b519-ac7d0481db29 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036206 Aug 17 08:41:22.600390 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 183/366] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:41:22.607289 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a60d5a30-279a-4f92-8457-f19c95d398fa tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:22.608076 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a60d5a30-279a-4f92-8457-f19c95d398fa tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:22.614113 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a60d5a30-279a-4f92-8457-f19c95d398fa tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:22.614597 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a60d5a30-279a-4f92-8457-f19c95d398fa tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:22.615030 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a60d5a30-279a-4f92-8457-f19c95d398fa tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:22.615747 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a60d5a30-279a-4f92-8457-f19c95d398fa tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:22.616198 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a60d5a30-279a-4f92-8457-f19c95d398fa tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:22.616613 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a60d5a30-279a-4f92-8457-f19c95d398fa tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:22.749860 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a60d5a30-279a-4f92-8457-f19c95d398fa tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:22.757809 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a60d5a30-279a-4f92-8457-f19c95d398fa tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1677 microversion: 2.1 time: 0.155400 Aug 17 08:41:22.758553 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 184/367] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:22 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:23.429160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-7ca28b3a-3eb3-4b02-a955-3f7613db5010 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:23.429860 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7ca28b3a-3eb3-4b02-a955-3f7613db5010 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: ce091a0c-0dc8-49aa-9ac6-d794a2dba74b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:23.435881 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7ca28b3a-3eb3-4b02-a955-3f7613db5010 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:23.436357 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7ca28b3a-3eb3-4b02-a955-3f7613db5010 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:23.436782 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7ca28b3a-3eb3-4b02-a955-3f7613db5010 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:23.437456 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7ca28b3a-3eb3-4b02-a955-3f7613db5010 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:23.437900 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7ca28b3a-3eb3-4b02-a955-3f7613db5010 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:23.438312 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7ca28b3a-3eb3-4b02-a955-3f7613db5010 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:23.469283 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7ca28b3a-3eb3-4b02-a955-3f7613db5010 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:23.469810 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7ca28b3a-3eb3-4b02-a955-3f7613db5010 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:23.470325 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7ca28b3a-3eb3-4b02-a955-3f7613db5010 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:23.470856 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-7ca28b3a-3eb3-4b02-a955-3f7613db5010 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lazy-loading 'fault' on Instance uuid ce091a0c-0dc8-49aa-9ac6-d794a2dba74b {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:41:23.518295 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-7ca28b3a-3eb3-4b02-a955-3f7613db5010 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:23.526043 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-7ca28b3a-3eb3-4b02-a955-3f7613db5010 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b" status: 200 len: 1309 microversion: 2.1 time: 0.101459 Aug 17 08:41:23.526586 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 184/368] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:23 2022] GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:23.779947 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-33c8c656-748a-4fe1-82b0-73cdb4ec8820 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:23.780454 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-33c8c656-748a-4fe1-82b0-73cdb4ec8820 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:23.786804 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33c8c656-748a-4fe1-82b0-73cdb4ec8820 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:23.787285 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33c8c656-748a-4fe1-82b0-73cdb4ec8820 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:23.787760 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33c8c656-748a-4fe1-82b0-73cdb4ec8820 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:23.788443 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33c8c656-748a-4fe1-82b0-73cdb4ec8820 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:23.788892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33c8c656-748a-4fe1-82b0-73cdb4ec8820 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:23.789314 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33c8c656-748a-4fe1-82b0-73cdb4ec8820 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:23.916052 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-33c8c656-748a-4fe1-82b0-73cdb4ec8820 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:23.923444 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-33c8c656-748a-4fe1-82b0-73cdb4ec8820 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1677 microversion: 2.1 time: 0.148106 Aug 17 08:41:23.924044 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 185/369] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:23 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:24.546740 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-fc75bc05-98e3-4032-a744-5b62a618ab70 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:24.547342 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-fc75bc05-98e3-4032-a744-5b62a618ab70 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: ce091a0c-0dc8-49aa-9ac6-d794a2dba74b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:24.553807 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fc75bc05-98e3-4032-a744-5b62a618ab70 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:24.554282 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fc75bc05-98e3-4032-a744-5b62a618ab70 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:24.554709 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fc75bc05-98e3-4032-a744-5b62a618ab70 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:24.555382 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fc75bc05-98e3-4032-a744-5b62a618ab70 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:24.555923 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fc75bc05-98e3-4032-a744-5b62a618ab70 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:24.556341 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fc75bc05-98e3-4032-a744-5b62a618ab70 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:24.570191 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-fc75bc05-98e3-4032-a744-5b62a618ab70 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] HTTP exception thrown: Instance ce091a0c-0dc8-49aa-9ac6-d794a2dba74b could not be found. Aug 17 08:41:24.571852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-fc75bc05-98e3-4032-a744-5b62a618ab70 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Request method failure captured: Aug 17 08:41:24.571852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b HTTP/1.1 Aug 17 08:41:24.571852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:41:24.571852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:41:24.571852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:41:24.571852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:41:24.571852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:41:24.571852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:41:24.571852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:41:24.571852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:41:24.571852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_KlhNmO-nqIRIWuBqjJhfP1sK8QVhqIKIdIgXdXB7pVpjkcles-bFFMHCzLZpbYSOOq2AePkPy-L7c22tPfKq5cbyS2X-XWtKvkLo3-RA_OX4NGnZie6c9YP0z2Zo9kKXjlvt75B1a2zVX3SLxgkb_HnXyZ5r4Neczf7-vI5u-9LcAw Aug 17 08:41:24.571852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:41:24.571852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:41:24.571852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:41:24.571852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:41:24.571852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:41:24.571852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:41:24.571852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: 4c20360aec7a4d60b7260305ab7e1b2f Aug 17 08:41:24.571852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-VolumesSnapshotTestJSON-429957818 Aug 17 08:41:24.571852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:41:24.571852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:41:24.573420 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4c20360aec7a4d60b7260305ab7e1b2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4c20360aec7a4d60b7260305ab7e1b2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4c20360aec7a4d60b7260305ab7e1b2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4c20360aec7a4d60b7260305ab7e1b2f", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:41:24.573420 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-VolumesSnapshotTestJSON-429957818 Aug 17 08:41:24.573420 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 4c20360aec7a4d60b7260305ab7e1b2f Aug 17 08:41:24.573420 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-429957818 Aug 17 08:41:24.573420 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-VolumesSnapshotTestJSON-429957818-project Aug 17 08:41:24.573420 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:41:24.573420 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:41:24.573420 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: 75a21876665f41c181a033dce1b0cea2 Aug 17 08:41:24.573420 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-VolumesSnapshotTestJSON-429957818-project Aug 17 08:41:24.573420 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:41:24.573420 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Instance ce091a0c-0dc8-49aa-9ac6-d794a2dba74b could not be found. Aug 17 08:41:24.573420 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'id': 'ce091a0c-0dc8-49aa-9ac6-d794a2dba74b'} Aug 17 08:41:24.574460 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:41:24.574460 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:41:24.574460 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:41:24.574460 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:41:24.574460 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:41:24.574460 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:41:24.574460 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:41:24.574460 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:41:24.574460 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:41:24.574460 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:41:24.574460 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce091a0c-0dc8-49aa-9ac6-d794a2dba74b could not be found. Aug 17 08:41:24.574460 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:41:24.574460 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:41:24.574460 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:41:24.574460 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:41:24.574460 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:41:24.574460 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:41:24.574460 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:41:24.574460 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:41:24.574460 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:41:24.575990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:41:24.575990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:41:24.575990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:41:24.575990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:41:24.575990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:41:24.575990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:41:24.575990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:41:24.575990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce091a0c-0dc8-49aa-9ac6-d794a2dba74b could not be found. Aug 17 08:41:24.575990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:41:24.575990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:41:24.575990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:41:24.575990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:41:24.575990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:41:24.575990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:41:24.575990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:41:24.575990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:41:24.575990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce091a0c-0dc8-49aa-9ac6-d794a2dba74b could not be found. Aug 17 08:41:24.575990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:41:24.577629 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-fc75bc05-98e3-4032-a744-5b62a618ab70 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Returning 404 to user: Instance ce091a0c-0dc8-49aa-9ac6-d794a2dba74b could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:41:24.577629 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-fc75bc05-98e3-4032-a744-5b62a618ab70 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b" status: 404 len: 111 microversion: 2.1 time: 0.030784 Aug 17 08:41:24.577629 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 185/370] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:24 2022] GET /compute/v2.1/servers/ce091a0c-0dc8-49aa-9ac6-d794a2dba74b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:41:24.944932 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-29f09090-0d7a-4a5e-a6df-784b5118d1c9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:24.945467 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-29f09090-0d7a-4a5e-a6df-784b5118d1c9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:24.952198 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-29f09090-0d7a-4a5e-a6df-784b5118d1c9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:24.952684 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-29f09090-0d7a-4a5e-a6df-784b5118d1c9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:24.953119 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-29f09090-0d7a-4a5e-a6df-784b5118d1c9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:24.953832 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-29f09090-0d7a-4a5e-a6df-784b5118d1c9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:24.954288 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-29f09090-0d7a-4a5e-a6df-784b5118d1c9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:24.954712 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-29f09090-0d7a-4a5e-a6df-784b5118d1c9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:25.080223 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-29f09090-0d7a-4a5e-a6df-784b5118d1c9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:25.087901 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-29f09090-0d7a-4a5e-a6df-784b5118d1c9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1677 microversion: 2.1 time: 0.146913 Aug 17 08:41:25.088467 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 186/371] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:24 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:26.109578 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-81fb9398-67d9-4cb8-be88-24ca78680620 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:26.110109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-81fb9398-67d9-4cb8-be88-24ca78680620 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:26.116547 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-81fb9398-67d9-4cb8-be88-24ca78680620 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:26.117023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-81fb9398-67d9-4cb8-be88-24ca78680620 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:26.117455 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-81fb9398-67d9-4cb8-be88-24ca78680620 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:26.118126 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-81fb9398-67d9-4cb8-be88-24ca78680620 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:26.118571 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-81fb9398-67d9-4cb8-be88-24ca78680620 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:26.118985 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-81fb9398-67d9-4cb8-be88-24ca78680620 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:26.246232 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-81fb9398-67d9-4cb8-be88-24ca78680620 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:26.254136 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-81fb9398-67d9-4cb8-be88-24ca78680620 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1677 microversion: 2.1 time: 0.148453 Aug 17 08:41:26.254693 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 186/372] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:26 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:41:26.439149 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1faabaa9-2076-4a94-bb8a-83ccace0469b tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:41:26.441446 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1faabaa9-2076-4a94-bb8a-83ccace0469b tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:26.447791 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1faabaa9-2076-4a94-bb8a-83ccace0469b tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:26.448260 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1faabaa9-2076-4a94-bb8a-83ccace0469b tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:26.448684 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1faabaa9-2076-4a94-bb8a-83ccace0469b tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:26.449354 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1faabaa9-2076-4a94-bb8a-83ccace0469b tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:26.449796 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1faabaa9-2076-4a94-bb8a-83ccace0469b tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:26.450829 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1faabaa9-2076-4a94-bb8a-83ccace0469b tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:26.520712 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1faabaa9-2076-4a94-bb8a-83ccace0469b tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "POST /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7/action" status: 202 len: 0 microversion: 2.1 time: 0.085796 Aug 17 08:41:26.521344 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 187/373] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 08:41:26 2022] POST /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:41:26.529528 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b4c79483-af60-4e47-9499-48bae0de8f46 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:26.530740 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b4c79483-af60-4e47-9499-48bae0de8f46 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:26.537010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b4c79483-af60-4e47-9499-48bae0de8f46 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:26.537488 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b4c79483-af60-4e47-9499-48bae0de8f46 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:26.537911 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b4c79483-af60-4e47-9499-48bae0de8f46 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:26.538584 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b4c79483-af60-4e47-9499-48bae0de8f46 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:26.539102 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b4c79483-af60-4e47-9499-48bae0de8f46 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:26.539631 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b4c79483-af60-4e47-9499-48bae0de8f46 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:26.681780 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b4c79483-af60-4e47-9499-48bae0de8f46 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:26.690193 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b4c79483-af60-4e47-9499-48bae0de8f46 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1750 microversion: 2.1 time: 0.164608 Aug 17 08:41:26.690750 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 187/374] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:26 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:27.275737 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-dff77c7b-f7d9-42f9-8f17-aeac8156bf34 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:27.276426 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-dff77c7b-f7d9-42f9-8f17-aeac8156bf34 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:27.283125 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dff77c7b-f7d9-42f9-8f17-aeac8156bf34 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:27.283634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dff77c7b-f7d9-42f9-8f17-aeac8156bf34 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:27.284066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dff77c7b-f7d9-42f9-8f17-aeac8156bf34 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:27.284745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dff77c7b-f7d9-42f9-8f17-aeac8156bf34 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:27.285194 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dff77c7b-f7d9-42f9-8f17-aeac8156bf34 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:27.285615 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dff77c7b-f7d9-42f9-8f17-aeac8156bf34 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:27.415297 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-dff77c7b-f7d9-42f9-8f17-aeac8156bf34 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:27.422683 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-dff77c7b-f7d9-42f9-8f17-aeac8156bf34 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1677 microversion: 2.1 time: 0.151330 Aug 17 08:41:27.423245 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 188/375] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:27 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:27.718262 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-af5e1d80-b9bf-4e14-a560-fda28157ae81 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:27.718856 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-af5e1d80-b9bf-4e14-a560-fda28157ae81 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:27.725094 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-af5e1d80-b9bf-4e14-a560-fda28157ae81 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:27.725563 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-af5e1d80-b9bf-4e14-a560-fda28157ae81 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:27.725985 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-af5e1d80-b9bf-4e14-a560-fda28157ae81 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:27.726656 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-af5e1d80-b9bf-4e14-a560-fda28157ae81 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:27.727094 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-af5e1d80-b9bf-4e14-a560-fda28157ae81 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:27.727506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-af5e1d80-b9bf-4e14-a560-fda28157ae81 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:27.878257 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-af5e1d80-b9bf-4e14-a560-fda28157ae81 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:27.886668 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-af5e1d80-b9bf-4e14-a560-fda28157ae81 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1750 microversion: 2.1 time: 0.172868 Aug 17 08:41:27.887308 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 188/376] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:27 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:28.443723 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b2737e67-bd0d-42b6-8a8f-464b2c2aed3c tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:28.444900 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b2737e67-bd0d-42b6-8a8f-464b2c2aed3c tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:28.452334 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b2737e67-bd0d-42b6-8a8f-464b2c2aed3c tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:28.452809 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b2737e67-bd0d-42b6-8a8f-464b2c2aed3c tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:28.453238 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b2737e67-bd0d-42b6-8a8f-464b2c2aed3c tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:28.453923 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b2737e67-bd0d-42b6-8a8f-464b2c2aed3c tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:28.454550 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b2737e67-bd0d-42b6-8a8f-464b2c2aed3c tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:28.454920 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b2737e67-bd0d-42b6-8a8f-464b2c2aed3c tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:28.532031 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-92223cea-1663-4fca-85b1-bc05ce96b127 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ad52f12-454a-4ba3-9218-8a16d667350b"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:41:28.534466 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-92223cea-1663-4fca-85b1-bc05ce96b127 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:28.540670 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-92223cea-1663-4fca-85b1-bc05ce96b127 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:28.541157 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-92223cea-1663-4fca-85b1-bc05ce96b127 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:28.541585 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-92223cea-1663-4fca-85b1-bc05ce96b127 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:28.542269 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-92223cea-1663-4fca-85b1-bc05ce96b127 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:28.542879 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-92223cea-1663-4fca-85b1-bc05ce96b127 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:28.543476 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-92223cea-1663-4fca-85b1-bc05ce96b127 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:28.596759 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b2737e67-bd0d-42b6-8a8f-464b2c2aed3c tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:28.604510 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b2737e67-bd0d-42b6-8a8f-464b2c2aed3c tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1677 microversion: 2.1 time: 0.164933 Aug 17 08:41:28.608261 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 189/377] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:28 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:28.822076 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-92223cea-1663-4fca-85b1-bc05ce96b127 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "POST /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294099 Aug 17 08:41:28.822723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 189/378] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 08:41:28 2022] POST /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:41:28.908301 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-58a1c636-010c-4b18-8429-5cc969b53323 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:28.909041 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-58a1c636-010c-4b18-8429-5cc969b53323 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:28.914735 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58a1c636-010c-4b18-8429-5cc969b53323 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:28.915221 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58a1c636-010c-4b18-8429-5cc969b53323 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:28.915683 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58a1c636-010c-4b18-8429-5cc969b53323 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:28.916368 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58a1c636-010c-4b18-8429-5cc969b53323 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:28.916815 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58a1c636-010c-4b18-8429-5cc969b53323 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:28.917231 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-58a1c636-010c-4b18-8429-5cc969b53323 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:29.060823 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-58a1c636-010c-4b18-8429-5cc969b53323 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:29.069198 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-58a1c636-010c-4b18-8429-5cc969b53323 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1755 microversion: 2.1 time: 0.165226 Aug 17 08:41:29.069828 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 190/379] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:28 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:29.629238 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-133ec41e-520b-411a-82b1-e47f246ebcd9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:29.629928 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-133ec41e-520b-411a-82b1-e47f246ebcd9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:29.636126 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-133ec41e-520b-411a-82b1-e47f246ebcd9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:29.636637 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-133ec41e-520b-411a-82b1-e47f246ebcd9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:29.637067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-133ec41e-520b-411a-82b1-e47f246ebcd9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:29.637743 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-133ec41e-520b-411a-82b1-e47f246ebcd9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:29.638186 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-133ec41e-520b-411a-82b1-e47f246ebcd9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:29.638600 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-133ec41e-520b-411a-82b1-e47f246ebcd9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:29.643123 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:41:29.772436 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-133ec41e-520b-411a-82b1-e47f246ebcd9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:29.780429 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-133ec41e-520b-411a-82b1-e47f246ebcd9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1677 microversion: 2.1 time: 0.155864 Aug 17 08:41:29.780988 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 190/380] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:29 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:30.091769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2565667a-06c0-4235-bf94-484c13475d04 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:30.092384 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-2565667a-06c0-4235-bf94-484c13475d04 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:30.098662 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2565667a-06c0-4235-bf94-484c13475d04 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:30.099138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2565667a-06c0-4235-bf94-484c13475d04 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:30.099584 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2565667a-06c0-4235-bf94-484c13475d04 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:30.100262 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2565667a-06c0-4235-bf94-484c13475d04 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:30.100729 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2565667a-06c0-4235-bf94-484c13475d04 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:30.101143 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2565667a-06c0-4235-bf94-484c13475d04 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:30.241563 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-2565667a-06c0-4235-bf94-484c13475d04 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:30.250245 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2565667a-06c0-4235-bf94-484c13475d04 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1755 microversion: 2.1 time: 0.162287 Aug 17 08:41:30.250778 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 191/381] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:30 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:30.801784 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5980fe0f-59ec-4273-b6c6-f8666187b3b2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:30.802363 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5980fe0f-59ec-4273-b6c6-f8666187b3b2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:30.808708 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5980fe0f-59ec-4273-b6c6-f8666187b3b2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:30.809187 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5980fe0f-59ec-4273-b6c6-f8666187b3b2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:30.809618 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5980fe0f-59ec-4273-b6c6-f8666187b3b2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:30.810290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5980fe0f-59ec-4273-b6c6-f8666187b3b2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:30.810767 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5980fe0f-59ec-4273-b6c6-f8666187b3b2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:30.811185 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5980fe0f-59ec-4273-b6c6-f8666187b3b2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:30.939373 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5980fe0f-59ec-4273-b6c6-f8666187b3b2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:30.947411 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5980fe0f-59ec-4273-b6c6-f8666187b3b2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1677 microversion: 2.1 time: 0.149521 Aug 17 08:41:30.948017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 191/382] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:30 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:31.271138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-57ded1d3-5dee-4350-be2c-2892d1876ead tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:31.271769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-57ded1d3-5dee-4350-be2c-2892d1876ead tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:31.278029 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-57ded1d3-5dee-4350-be2c-2892d1876ead tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:31.278507 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-57ded1d3-5dee-4350-be2c-2892d1876ead tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:31.278942 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-57ded1d3-5dee-4350-be2c-2892d1876ead tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:31.280281 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-57ded1d3-5dee-4350-be2c-2892d1876ead tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:31.280734 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-57ded1d3-5dee-4350-be2c-2892d1876ead tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:31.281152 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-57ded1d3-5dee-4350-be2c-2892d1876ead tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:31.298900 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:41:31.422720 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-57ded1d3-5dee-4350-be2c-2892d1876ead tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:31.430537 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-57ded1d3-5dee-4350-be2c-2892d1876ead tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1755 microversion: 2.1 time: 0.163228 Aug 17 08:41:31.431114 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 192/383] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:31 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:31.967998 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ab68f554-8fc3-49e3-a8f1-0001f61a3cf9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:31.968618 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ab68f554-8fc3-49e3-a8f1-0001f61a3cf9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:31.974937 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ab68f554-8fc3-49e3-a8f1-0001f61a3cf9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:31.975418 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ab68f554-8fc3-49e3-a8f1-0001f61a3cf9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:31.975883 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ab68f554-8fc3-49e3-a8f1-0001f61a3cf9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:31.976567 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ab68f554-8fc3-49e3-a8f1-0001f61a3cf9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:31.977015 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ab68f554-8fc3-49e3-a8f1-0001f61a3cf9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:31.977434 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ab68f554-8fc3-49e3-a8f1-0001f61a3cf9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:32.103503 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ab68f554-8fc3-49e3-a8f1-0001f61a3cf9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:32.111503 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ab68f554-8fc3-49e3-a8f1-0001f61a3cf9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1677 microversion: 2.1 time: 0.147308 Aug 17 08:41:32.112093 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 192/384] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:31 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:32.409125 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-14613973-3fae-402e-ab98-671769309922 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1320225288", "imageRef": "4467450c-a35c-42e3-af85-a13291b0b2aa", "flavorRef": "452", "networks": [{"uuid": "da2187ec-7cb4-4ddb-8853-c6d340e46221"}]}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:41:32.451295 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b3aaf502-70d4-456b-beaf-eba0ead0468c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:32.452166 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b3aaf502-70d4-456b-beaf-eba0ead0468c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:32.458478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b3aaf502-70d4-456b-beaf-eba0ead0468c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:32.459024 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b3aaf502-70d4-456b-beaf-eba0ead0468c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:32.459372 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b3aaf502-70d4-456b-beaf-eba0ead0468c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:32.460080 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b3aaf502-70d4-456b-beaf-eba0ead0468c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:32.460530 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b3aaf502-70d4-456b-beaf-eba0ead0468c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:32.460955 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b3aaf502-70d4-456b-beaf-eba0ead0468c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:32.463524 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.network.neutron [None req-14613973-3fae-402e-ab98-671769309922 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] validate_networks() for [('da2187ec-7cb4-4ddb-8853-c6d340e46221', None, None, None, None, None)] {{(pid=127297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 08:41:32.614049 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b3aaf502-70d4-456b-beaf-eba0ead0468c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:32.622307 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b3aaf502-70d4-456b-beaf-eba0ead0468c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1755 microversion: 2.1 time: 0.174828 Aug 17 08:41:32.623179 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 193/385] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:32 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:41:32.818791 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-14613973-3fae-402e-ab98-671769309922 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Flavor limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 08:41:32.819205 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-14613973-3fae-402e-ab98-671769309922 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Image limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 08:41:32.819712 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-14613973-3fae-402e-ab98-671769309922 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Flavor pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 08:41:32.820119 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-14613973-3fae-402e-ab98-671769309922 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Image pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 08:41:32.820527 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-14613973-3fae-402e-ab98-671769309922 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 08:41:32.829861 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14613973-3fae-402e-ab98-671769309922 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:32.830342 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14613973-3fae-402e-ab98-671769309922 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:32.831029 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14613973-3fae-402e-ab98-671769309922 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:32.831803 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14613973-3fae-402e-ab98-671769309922 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:32.832255 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14613973-3fae-402e-ab98-671769309922 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:32.832676 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14613973-3fae-402e-ab98-671769309922 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:32.849938 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-14613973-3fae-402e-ab98-671769309922 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Getting quotas for project 4c20360aec7a4d60b7260305ab7e1b2f. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:41:32.853844 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-14613973-3fae-402e-ab98-671769309922 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Getting quotas for user 75a21876665f41c181a033dce1b0cea2 and project 4c20360aec7a4d60b7260305ab7e1b2f. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:41:32.864566 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-14613973-3fae-402e-ab98-671769309922 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Going to run 1 instances... {{(pid=127297) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 08:41:32.866777 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-14613973-3fae-402e-ab98-671769309922 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: 2d939aeb-93a2-4b10-a699-d45ac67dd0f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4467450c-a35c-42e3-af85-a13291b0b2aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 08:41:32.909451 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-14613973-3fae-402e-ab98-671769309922 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505349 Aug 17 08:41:32.910086 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 193/386] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 08:41:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 08:41:32.921630 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5f459e5b-2403-4bdd-9888-65a25f65a03f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:32.922223 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5f459e5b-2403-4bdd-9888-65a25f65a03f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: 2d939aeb-93a2-4b10-a699-d45ac67dd0f4] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:32.975849 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5f459e5b-2403-4bdd-9888-65a25f65a03f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:32.982406 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5f459e5b-2403-4bdd-9888-65a25f65a03f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4" status: 200 len: 1219 microversion: 2.1 time: 0.065422 Aug 17 08:41:32.982980 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 194/387] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:32 2022] GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:33.132351 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2394fd2f-65bc-474b-9cd9-d25620992ca8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:33.132955 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-2394fd2f-65bc-474b-9cd9-d25620992ca8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:33.139484 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2394fd2f-65bc-474b-9cd9-d25620992ca8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:33.140004 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2394fd2f-65bc-474b-9cd9-d25620992ca8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:33.140664 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2394fd2f-65bc-474b-9cd9-d25620992ca8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:33.141108 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2394fd2f-65bc-474b-9cd9-d25620992ca8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:33.141558 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2394fd2f-65bc-474b-9cd9-d25620992ca8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:33.141979 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2394fd2f-65bc-474b-9cd9-d25620992ca8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:33.274273 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-2394fd2f-65bc-474b-9cd9-d25620992ca8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:33.282206 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2394fd2f-65bc-474b-9cd9-d25620992ca8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1654 microversion: 2.1 time: 0.153702 Aug 17 08:41:33.282784 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 194/388] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:33 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1654 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:41:33.302846 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-fa57b67e-0360-4383-9e57-04a644b7677a tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:41:33.309876 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fa57b67e-0360-4383-9e57-04a644b7677a tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:33.310983 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fa57b67e-0360-4383-9e57-04a644b7677a tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:33.311418 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fa57b67e-0360-4383-9e57-04a644b7677a tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:33.332997 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-fa57b67e-0360-4383-9e57-04a644b7677a tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Going to try to start instance {{(pid=127298) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 17 08:41:33.374857 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-fa57b67e-0360-4383-9e57-04a644b7677a tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "POST /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9/action" status: 202 len: 0 microversion: 2.1 time: 0.075524 Aug 17 08:41:33.375434 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 195/389] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 08:41:33 2022] POST /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:41:33.384085 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4f53a503-121a-470c-aa8e-02b8e6df5188 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:33.384697 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-4f53a503-121a-470c-aa8e-02b8e6df5188 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:33.390618 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f53a503-121a-470c-aa8e-02b8e6df5188 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:33.391106 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f53a503-121a-470c-aa8e-02b8e6df5188 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:33.391580 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f53a503-121a-470c-aa8e-02b8e6df5188 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:33.392303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f53a503-121a-470c-aa8e-02b8e6df5188 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:33.392759 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f53a503-121a-470c-aa8e-02b8e6df5188 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:33.393175 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4f53a503-121a-470c-aa8e-02b8e6df5188 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:33.538056 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-4f53a503-121a-470c-aa8e-02b8e6df5188 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:33.546556 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4f53a503-121a-470c-aa8e-02b8e6df5188 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1663 microversion: 2.1 time: 0.166730 Aug 17 08:41:33.547132 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 195/390] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:33 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1663 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:33.643786 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-545c2a2d-09ee-4143-bde4-712f1d9c3ae6 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:33.644468 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-545c2a2d-09ee-4143-bde4-712f1d9c3ae6 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:33.650412 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-545c2a2d-09ee-4143-bde4-712f1d9c3ae6 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:33.650882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-545c2a2d-09ee-4143-bde4-712f1d9c3ae6 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:33.651307 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-545c2a2d-09ee-4143-bde4-712f1d9c3ae6 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:33.651999 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-545c2a2d-09ee-4143-bde4-712f1d9c3ae6 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:33.652441 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-545c2a2d-09ee-4143-bde4-712f1d9c3ae6 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:33.652852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-545c2a2d-09ee-4143-bde4-712f1d9c3ae6 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:33.798996 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-545c2a2d-09ee-4143-bde4-712f1d9c3ae6 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:33.806765 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-545c2a2d-09ee-4143-bde4-712f1d9c3ae6 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1755 microversion: 2.1 time: 0.167200 Aug 17 08:41:33.807326 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 196/391] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:33 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:34.004033 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-151d8cd7-03ad-4aad-ab65-0fa7751a72ea tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:34.004704 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-151d8cd7-03ad-4aad-ab65-0fa7751a72ea tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: 2d939aeb-93a2-4b10-a699-d45ac67dd0f4] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:34.010978 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-151d8cd7-03ad-4aad-ab65-0fa7751a72ea tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:34.011460 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-151d8cd7-03ad-4aad-ab65-0fa7751a72ea tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:34.011914 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-151d8cd7-03ad-4aad-ab65-0fa7751a72ea tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:34.012593 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-151d8cd7-03ad-4aad-ab65-0fa7751a72ea tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:34.013045 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-151d8cd7-03ad-4aad-ab65-0fa7751a72ea tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:34.013494 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-151d8cd7-03ad-4aad-ab65-0fa7751a72ea tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:34.093556 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-151d8cd7-03ad-4aad-ab65-0fa7751a72ea tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:34.101410 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-151d8cd7-03ad-4aad-ab65-0fa7751a72ea tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4" status: 200 len: 1271 microversion: 2.1 time: 0.101658 Aug 17 08:41:34.116452 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 196/392] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:33 2022] GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4 => generated 1271 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:34.567949 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-befde42d-34f2-41fa-8836-df42727d9b27 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:34.568767 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-befde42d-34f2-41fa-8836-df42727d9b27 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:34.576053 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-befde42d-34f2-41fa-8836-df42727d9b27 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:34.576664 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-befde42d-34f2-41fa-8836-df42727d9b27 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:34.577524 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-befde42d-34f2-41fa-8836-df42727d9b27 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:34.578118 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-befde42d-34f2-41fa-8836-df42727d9b27 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:34.578687 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-befde42d-34f2-41fa-8836-df42727d9b27 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:34.579205 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-befde42d-34f2-41fa-8836-df42727d9b27 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:34.788332 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-befde42d-34f2-41fa-8836-df42727d9b27 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:34.795926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-befde42d-34f2-41fa-8836-df42727d9b27 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1663 microversion: 2.1 time: 0.231808 Aug 17 08:41:34.796782 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 197/393] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:34 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1663 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:34.828549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-aec6a5e7-4749-4488-bdb1-22c44543f6f4 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:34.829373 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-aec6a5e7-4749-4488-bdb1-22c44543f6f4 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:34.836313 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aec6a5e7-4749-4488-bdb1-22c44543f6f4 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:34.836845 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aec6a5e7-4749-4488-bdb1-22c44543f6f4 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:34.837347 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aec6a5e7-4749-4488-bdb1-22c44543f6f4 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:34.838108 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aec6a5e7-4749-4488-bdb1-22c44543f6f4 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:34.838564 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aec6a5e7-4749-4488-bdb1-22c44543f6f4 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:34.838986 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aec6a5e7-4749-4488-bdb1-22c44543f6f4 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:34.988854 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-aec6a5e7-4749-4488-bdb1-22c44543f6f4 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:34.995761 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-aec6a5e7-4749-4488-bdb1-22c44543f6f4 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1755 microversion: 2.1 time: 0.171611 Aug 17 08:41:34.996328 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 197/394] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:34 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:35.124230 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-76ce24d7-a7ba-4ac7-80a7-784a977ad0ff tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:35.124777 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-76ce24d7-a7ba-4ac7-80a7-784a977ad0ff tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: 2d939aeb-93a2-4b10-a699-d45ac67dd0f4] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:35.130630 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-76ce24d7-a7ba-4ac7-80a7-784a977ad0ff tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:35.131112 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-76ce24d7-a7ba-4ac7-80a7-784a977ad0ff tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:35.131570 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-76ce24d7-a7ba-4ac7-80a7-784a977ad0ff tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:35.132261 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-76ce24d7-a7ba-4ac7-80a7-784a977ad0ff tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:35.132711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-76ce24d7-a7ba-4ac7-80a7-784a977ad0ff tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:35.133128 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-76ce24d7-a7ba-4ac7-80a7-784a977ad0ff tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:35.320566 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-76ce24d7-a7ba-4ac7-80a7-784a977ad0ff tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:35.328586 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-76ce24d7-a7ba-4ac7-80a7-784a977ad0ff tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4" status: 200 len: 1319 microversion: 2.1 time: 0.208859 Aug 17 08:41:35.329160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 198/395] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:35 2022] GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:35.595296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-9d8b7507-3b67-4f0a-8450-2d1493509ce1 req-e59728f0-9f58-463d-aa94-fde4a38d3ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d939aeb-93a2-4b10-a699-d45ac67dd0f4", "tag": "43b90ab5-c802-4901-b5c4-68ce23827175"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:41:35.606073 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-9d8b7507-3b67-4f0a-8450-2d1493509ce1 req-e59728f0-9f58-463d-aa94-fde4a38d3ee8 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:35.606694 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-9d8b7507-3b67-4f0a-8450-2d1493509ce1 req-e59728f0-9f58-463d-aa94-fde4a38d3ee8 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:35.607889 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-9d8b7507-3b67-4f0a-8450-2d1493509ce1 req-e59728f0-9f58-463d-aa94-fde4a38d3ee8 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:35.619353 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-9d8b7507-3b67-4f0a-8450-2d1493509ce1 req-e59728f0-9f58-463d-aa94-fde4a38d3ee8 service nova] Creating event network-changed:43b90ab5-c802-4901-b5c4-68ce23827175 for instance 2d939aeb-93a2-4b10-a699-d45ac67dd0f4 on hv-cinder-85331 Aug 17 08:41:35.638070 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-9d8b7507-3b67-4f0a-8450-2d1493509ce1 req-e59728f0-9f58-463d-aa94-fde4a38d3ee8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047238 Aug 17 08:41:35.638961 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 198/396] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:41:35.817473 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-74eb92a8-cbb8-4f3e-acbf-e88cf4e03c5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:35.818083 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-74eb92a8-cbb8-4f3e-acbf-e88cf4e03c5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:35.824436 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-74eb92a8-cbb8-4f3e-acbf-e88cf4e03c5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:35.824921 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-74eb92a8-cbb8-4f3e-acbf-e88cf4e03c5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:35.825354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-74eb92a8-cbb8-4f3e-acbf-e88cf4e03c5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:35.826038 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-74eb92a8-cbb8-4f3e-acbf-e88cf4e03c5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:35.826490 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-74eb92a8-cbb8-4f3e-acbf-e88cf4e03c5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:35.826910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-74eb92a8-cbb8-4f3e-acbf-e88cf4e03c5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:36.017486 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-489a1274-7e82-4aa2-934e-1aa2da5ce693 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:36.018079 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-489a1274-7e82-4aa2-934e-1aa2da5ce693 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:36.024851 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-489a1274-7e82-4aa2-934e-1aa2da5ce693 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:36.025332 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-489a1274-7e82-4aa2-934e-1aa2da5ce693 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:36.025759 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-489a1274-7e82-4aa2-934e-1aa2da5ce693 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:36.026450 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-489a1274-7e82-4aa2-934e-1aa2da5ce693 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:36.026894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-489a1274-7e82-4aa2-934e-1aa2da5ce693 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:36.027311 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-489a1274-7e82-4aa2-934e-1aa2da5ce693 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:36.305168 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-74eb92a8-cbb8-4f3e-acbf-e88cf4e03c5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:36.313045 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-74eb92a8-cbb8-4f3e-acbf-e88cf4e03c5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1667 microversion: 2.1 time: 0.499358 Aug 17 08:41:36.318414 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 199/397] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:35 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1667 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:36.349246 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-7a774694-14a0-4d45-9ec8-1d17e6a5f5fc tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:36.349846 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7a774694-14a0-4d45-9ec8-1d17e6a5f5fc tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: 2d939aeb-93a2-4b10-a699-d45ac67dd0f4] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:36.352988 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-489a1274-7e82-4aa2-934e-1aa2da5ce693 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:36.355811 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7a774694-14a0-4d45-9ec8-1d17e6a5f5fc tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:36.356302 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7a774694-14a0-4d45-9ec8-1d17e6a5f5fc tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:36.356731 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7a774694-14a0-4d45-9ec8-1d17e6a5f5fc tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:36.357435 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7a774694-14a0-4d45-9ec8-1d17e6a5f5fc tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:36.357881 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7a774694-14a0-4d45-9ec8-1d17e6a5f5fc tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:36.358295 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7a774694-14a0-4d45-9ec8-1d17e6a5f5fc tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:36.360932 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-489a1274-7e82-4aa2-934e-1aa2da5ce693 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1755 microversion: 2.1 time: 0.347766 Aug 17 08:41:36.361503 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 199/398] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:36 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1755 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:41:36.568431 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-7a774694-14a0-4d45-9ec8-1d17e6a5f5fc tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:36.576345 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-7a774694-14a0-4d45-9ec8-1d17e6a5f5fc tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4" status: 200 len: 1319 microversion: 2.1 time: 0.230440 Aug 17 08:41:36.576913 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 200/399] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:36 2022] GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:41:37.381620 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6c81afe9-c336-4314-ace8-899aa584abb2 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:37.382220 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6c81afe9-c336-4314-ace8-899aa584abb2 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:37.388753 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c81afe9-c336-4314-ace8-899aa584abb2 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:37.389232 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c81afe9-c336-4314-ace8-899aa584abb2 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:37.389663 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c81afe9-c336-4314-ace8-899aa584abb2 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:37.390342 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c81afe9-c336-4314-ace8-899aa584abb2 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:37.390791 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c81afe9-c336-4314-ace8-899aa584abb2 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:37.391209 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c81afe9-c336-4314-ace8-899aa584abb2 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:37.526916 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6c81afe9-c336-4314-ace8-899aa584abb2 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:37.535264 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6c81afe9-c336-4314-ace8-899aa584abb2 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1755 microversion: 2.1 time: 0.157485 Aug 17 08:41:37.535858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 200/400] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:37 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:37.597455 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8dd62632-e5c2-44ad-a6aa-49581471af1f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:37.597984 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8dd62632-e5c2-44ad-a6aa-49581471af1f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: 2d939aeb-93a2-4b10-a699-d45ac67dd0f4] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:37.604408 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8dd62632-e5c2-44ad-a6aa-49581471af1f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:37.604885 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8dd62632-e5c2-44ad-a6aa-49581471af1f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:37.605315 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8dd62632-e5c2-44ad-a6aa-49581471af1f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:37.605997 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8dd62632-e5c2-44ad-a6aa-49581471af1f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:37.606445 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8dd62632-e5c2-44ad-a6aa-49581471af1f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:37.606858 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8dd62632-e5c2-44ad-a6aa-49581471af1f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:37.733547 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8dd62632-e5c2-44ad-a6aa-49581471af1f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:37.740885 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8dd62632-e5c2-44ad-a6aa-49581471af1f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4" status: 200 len: 1319 microversion: 2.1 time: 0.147403 Aug 17 08:41:37.741449 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 201/401] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:37 2022] GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:38.556678 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-be4a13e2-2565-4d3d-80f2-587798aa1f72 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:38.557296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-be4a13e2-2565-4d3d-80f2-587798aa1f72 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:38.564262 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-be4a13e2-2565-4d3d-80f2-587798aa1f72 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:38.564728 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-be4a13e2-2565-4d3d-80f2-587798aa1f72 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:38.565152 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-be4a13e2-2565-4d3d-80f2-587798aa1f72 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:38.565825 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-be4a13e2-2565-4d3d-80f2-587798aa1f72 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:38.566263 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-be4a13e2-2565-4d3d-80f2-587798aa1f72 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:38.566675 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-be4a13e2-2565-4d3d-80f2-587798aa1f72 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:38.714553 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-be4a13e2-2565-4d3d-80f2-587798aa1f72 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:38.722704 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-be4a13e2-2565-4d3d-80f2-587798aa1f72 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1755 microversion: 2.1 time: 0.169843 Aug 17 08:41:38.723295 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 201/402] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:38 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:38.760347 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-57e6b276-4e52-46e3-b68b-7e6e32aaf3ed tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:38.760955 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-57e6b276-4e52-46e3-b68b-7e6e32aaf3ed tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: 2d939aeb-93a2-4b10-a699-d45ac67dd0f4] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:38.767731 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-57e6b276-4e52-46e3-b68b-7e6e32aaf3ed tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:38.768159 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-57e6b276-4e52-46e3-b68b-7e6e32aaf3ed tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:38.768589 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-57e6b276-4e52-46e3-b68b-7e6e32aaf3ed tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:38.769325 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-57e6b276-4e52-46e3-b68b-7e6e32aaf3ed tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:38.769790 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-57e6b276-4e52-46e3-b68b-7e6e32aaf3ed tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:38.770208 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-57e6b276-4e52-46e3-b68b-7e6e32aaf3ed tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:38.906262 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-57e6b276-4e52-46e3-b68b-7e6e32aaf3ed tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:38.914349 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-57e6b276-4e52-46e3-b68b-7e6e32aaf3ed tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4" status: 200 len: 1319 microversion: 2.1 time: 0.157878 Aug 17 08:41:38.914913 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 202/403] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:38 2022] GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:39.513768 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b986ca88-4567-40a1-8c66-48d8b7d69536 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:41:39.515956 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b986ca88-4567-40a1-8c66-48d8b7d69536 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:39.522194 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b986ca88-4567-40a1-8c66-48d8b7d69536 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:39.522665 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b986ca88-4567-40a1-8c66-48d8b7d69536 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:39.523086 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b986ca88-4567-40a1-8c66-48d8b7d69536 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:39.523776 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b986ca88-4567-40a1-8c66-48d8b7d69536 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:39.524220 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b986ca88-4567-40a1-8c66-48d8b7d69536 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:39.524633 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b986ca88-4567-40a1-8c66-48d8b7d69536 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:39.547045 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.objects.instance [None req-b986ca88-4567-40a1-8c66-48d8b7d69536 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lazy-loading 'flavor' on Instance uuid 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 {{(pid=127297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:41:39.708738 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b986ca88-4567-40a1-8c66-48d8b7d69536 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "POST /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1/action" status: 200 len: 32 microversion: 2.1 time: 0.198695 Aug 17 08:41:39.709826 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 202/404] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 08:41:39 2022] POST /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1/action => generated 32 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 08:41:39.723899 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-11e6a617-9be9-454e-968a-6ed45c9c9459 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:39.724519 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-11e6a617-9be9-454e-968a-6ed45c9c9459 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:39.732842 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-11e6a617-9be9-454e-968a-6ed45c9c9459 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:39.733314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-11e6a617-9be9-454e-968a-6ed45c9c9459 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:39.733739 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-11e6a617-9be9-454e-968a-6ed45c9c9459 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:39.734412 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-11e6a617-9be9-454e-968a-6ed45c9c9459 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:39.734852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-11e6a617-9be9-454e-968a-6ed45c9c9459 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:39.735260 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-11e6a617-9be9-454e-968a-6ed45c9c9459 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:39.746190 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c97385b6-7f4a-4524-bbf9-3f18eef3057c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:39.747162 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c97385b6-7f4a-4524-bbf9-3f18eef3057c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:39.753714 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c97385b6-7f4a-4524-bbf9-3f18eef3057c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:39.754198 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c97385b6-7f4a-4524-bbf9-3f18eef3057c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:39.754810 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c97385b6-7f4a-4524-bbf9-3f18eef3057c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:39.755513 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c97385b6-7f4a-4524-bbf9-3f18eef3057c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:39.755992 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c97385b6-7f4a-4524-bbf9-3f18eef3057c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:39.756416 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c97385b6-7f4a-4524-bbf9-3f18eef3057c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:39.899573 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c97385b6-7f4a-4524-bbf9-3f18eef3057c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:39.908100 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c97385b6-7f4a-4524-bbf9-3f18eef3057c tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1755 microversion: 2.1 time: 0.166206 Aug 17 08:41:39.908667 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 203/405] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:39 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:41:39.935347 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6f4453d6-1bad-4f7c-9945-5b8695fa15ab tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:39.935978 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6f4453d6-1bad-4f7c-9945-5b8695fa15ab tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: 2d939aeb-93a2-4b10-a699-d45ac67dd0f4] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:39.941796 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6f4453d6-1bad-4f7c-9945-5b8695fa15ab tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:39.942276 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6f4453d6-1bad-4f7c-9945-5b8695fa15ab tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:39.942711 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6f4453d6-1bad-4f7c-9945-5b8695fa15ab tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:39.943389 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6f4453d6-1bad-4f7c-9945-5b8695fa15ab tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:39.943867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6f4453d6-1bad-4f7c-9945-5b8695fa15ab tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:39.944297 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6f4453d6-1bad-4f7c-9945-5b8695fa15ab tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:39.952082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-11e6a617-9be9-454e-968a-6ed45c9c9459 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:39.960578 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-11e6a617-9be9-454e-968a-6ed45c9c9459 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1736 microversion: 2.1 time: 0.240375 Aug 17 08:41:39.961317 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 203/406] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:39 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1736 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:41:40.078576 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6f4453d6-1bad-4f7c-9945-5b8695fa15ab tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:40.086537 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6f4453d6-1bad-4f7c-9945-5b8695fa15ab tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4" status: 200 len: 1319 microversion: 2.1 time: 0.154928 Aug 17 08:41:40.087104 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 204/407] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:39 2022] GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:41:40.761923 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-b45531c8-b3e2-449d-962b-ee801c987c72 req-85b6a2ce-4373-48a1-97d5-d831d51f4b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d939aeb-93a2-4b10-a699-d45ac67dd0f4", "name": "network-vif-plugged", "status": "completed", "tag": "43b90ab5-c802-4901-b5c4-68ce23827175"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:41:40.771846 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-b45531c8-b3e2-449d-962b-ee801c987c72 req-85b6a2ce-4373-48a1-97d5-d831d51f4b8b service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:40.772410 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-b45531c8-b3e2-449d-962b-ee801c987c72 req-85b6a2ce-4373-48a1-97d5-d831d51f4b8b service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:40.772834 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-b45531c8-b3e2-449d-962b-ee801c987c72 req-85b6a2ce-4373-48a1-97d5-d831d51f4b8b service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:40.784183 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-b45531c8-b3e2-449d-962b-ee801c987c72 req-85b6a2ce-4373-48a1-97d5-d831d51f4b8b service nova] Creating event network-vif-plugged:43b90ab5-c802-4901-b5c4-68ce23827175 for instance 2d939aeb-93a2-4b10-a699-d45ac67dd0f4 on hv-cinder-85331 Aug 17 08:41:40.789185 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-b45531c8-b3e2-449d-962b-ee801c987c72 req-85b6a2ce-4373-48a1-97d5-d831d51f4b8b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030981 Aug 17 08:41:40.789956 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 204/408] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:41:40.929127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d99cfa07-82be-42ce-9abe-cdfd8271165a tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:40.929719 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d99cfa07-82be-42ce-9abe-cdfd8271165a tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:40.936844 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d99cfa07-82be-42ce-9abe-cdfd8271165a tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:40.937334 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d99cfa07-82be-42ce-9abe-cdfd8271165a tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:40.937763 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d99cfa07-82be-42ce-9abe-cdfd8271165a tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:40.938452 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d99cfa07-82be-42ce-9abe-cdfd8271165a tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:40.938904 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d99cfa07-82be-42ce-9abe-cdfd8271165a tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:40.939329 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d99cfa07-82be-42ce-9abe-cdfd8271165a tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:40.983344 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-26dcc5a1-cf01-40d3-959f-2cf704a80ace tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:40.984078 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-26dcc5a1-cf01-40d3-959f-2cf704a80ace tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:40.991488 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-26dcc5a1-cf01-40d3-959f-2cf704a80ace tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:40.991993 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-26dcc5a1-cf01-40d3-959f-2cf704a80ace tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:40.992424 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-26dcc5a1-cf01-40d3-959f-2cf704a80ace tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:40.993112 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-26dcc5a1-cf01-40d3-959f-2cf704a80ace tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:40.993568 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-26dcc5a1-cf01-40d3-959f-2cf704a80ace tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:40.993992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-26dcc5a1-cf01-40d3-959f-2cf704a80ace tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:41.084617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d99cfa07-82be-42ce-9abe-cdfd8271165a tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:41.093597 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d99cfa07-82be-42ce-9abe-cdfd8271165a tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1755 microversion: 2.1 time: 0.168252 Aug 17 08:41:41.094174 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 205/409] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:40 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:41.107639 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-74a9e8fa-20ed-42de-9fb0-10e72b17834d tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:41.108506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-74a9e8fa-20ed-42de-9fb0-10e72b17834d tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: 2d939aeb-93a2-4b10-a699-d45ac67dd0f4] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:41.115113 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-74a9e8fa-20ed-42de-9fb0-10e72b17834d tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:41.115717 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-74a9e8fa-20ed-42de-9fb0-10e72b17834d tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:41.116198 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-74a9e8fa-20ed-42de-9fb0-10e72b17834d tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:41.117075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-74a9e8fa-20ed-42de-9fb0-10e72b17834d tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:41.117730 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-74a9e8fa-20ed-42de-9fb0-10e72b17834d tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:41.118134 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-74a9e8fa-20ed-42de-9fb0-10e72b17834d tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:41.159622 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-26dcc5a1-cf01-40d3-959f-2cf704a80ace tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:41.167729 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-26dcc5a1-cf01-40d3-959f-2cf704a80ace tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1736 microversion: 2.1 time: 0.189142 Aug 17 08:41:41.168298 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 205/410] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:40 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:41:41.252199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-74a9e8fa-20ed-42de-9fb0-10e72b17834d tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:41.259464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-74a9e8fa-20ed-42de-9fb0-10e72b17834d tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4" status: 200 len: 1319 microversion: 2.1 time: 0.155974 Aug 17 08:41:41.260057 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 206/411] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:41 2022] GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:42.115661 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-16935672-809d-4ce3-9ef4-9c1bc2b73acd tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:42.116283 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-16935672-809d-4ce3-9ef4-9c1bc2b73acd tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:42.122601 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-16935672-809d-4ce3-9ef4-9c1bc2b73acd tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:42.123071 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-16935672-809d-4ce3-9ef4-9c1bc2b73acd tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:42.123493 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-16935672-809d-4ce3-9ef4-9c1bc2b73acd tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:42.124187 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-16935672-809d-4ce3-9ef4-9c1bc2b73acd tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:42.124629 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-16935672-809d-4ce3-9ef4-9c1bc2b73acd tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:42.125038 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-16935672-809d-4ce3-9ef4-9c1bc2b73acd tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:42.188997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7dff6d1d-e820-4d03-b8ef-0c0341907abd tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:42.190214 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7dff6d1d-e820-4d03-b8ef-0c0341907abd tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:42.196094 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7dff6d1d-e820-4d03-b8ef-0c0341907abd tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:42.196577 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7dff6d1d-e820-4d03-b8ef-0c0341907abd tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:42.197001 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7dff6d1d-e820-4d03-b8ef-0c0341907abd tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:42.197674 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7dff6d1d-e820-4d03-b8ef-0c0341907abd tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:42.198116 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7dff6d1d-e820-4d03-b8ef-0c0341907abd tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:42.198531 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7dff6d1d-e820-4d03-b8ef-0c0341907abd tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:42.269057 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-16935672-809d-4ce3-9ef4-9c1bc2b73acd tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:42.277055 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-16935672-809d-4ce3-9ef4-9c1bc2b73acd tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1755 microversion: 2.1 time: 0.165223 Aug 17 08:41:42.277622 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 206/412] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:42 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:42.282550 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a9c99bfd-3ece-4810-a811-c41842c50e04 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:42.283145 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a9c99bfd-3ece-4810-a811-c41842c50e04 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: 2d939aeb-93a2-4b10-a699-d45ac67dd0f4] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:42.288937 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a9c99bfd-3ece-4810-a811-c41842c50e04 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:42.289415 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a9c99bfd-3ece-4810-a811-c41842c50e04 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:42.289844 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a9c99bfd-3ece-4810-a811-c41842c50e04 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:42.290521 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a9c99bfd-3ece-4810-a811-c41842c50e04 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:42.290968 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a9c99bfd-3ece-4810-a811-c41842c50e04 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:42.291381 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a9c99bfd-3ece-4810-a811-c41842c50e04 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:42.309128 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:41:42.333343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-7dff6d1d-e820-4d03-b8ef-0c0341907abd tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:42.341877 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-7dff6d1d-e820-4d03-b8ef-0c0341907abd tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1736 microversion: 2.1 time: 0.156013 Aug 17 08:41:42.342440 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 207/413] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:42 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:41:42.424190 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a9c99bfd-3ece-4810-a811-c41842c50e04 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:42.431424 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a9c99bfd-3ece-4810-a811-c41842c50e04 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4" status: 200 len: 1319 microversion: 2.1 time: 0.152882 Aug 17 08:41:42.432009 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 207/414] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:42 2022] GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:43.298645 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-33367591-14f7-4da0-a710-a0f832e8b663 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:43.299211 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-33367591-14f7-4da0-a710-a0f832e8b663 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:43.301178 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:41:43.301833 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=6 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:41:43.307923 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33367591-14f7-4da0-a710-a0f832e8b663 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:43.308403 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33367591-14f7-4da0-a710-a0f832e8b663 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:43.308832 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33367591-14f7-4da0-a710-a0f832e8b663 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:43.309516 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33367591-14f7-4da0-a710-a0f832e8b663 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:43.309963 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33367591-14f7-4da0-a710-a0f832e8b663 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:43.310381 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33367591-14f7-4da0-a710-a0f832e8b663 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:43.328313 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:41:43.362161 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-abe7190f-c038-4102-90b8-a57a9317d5e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:43.362768 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-abe7190f-c038-4102-90b8-a57a9317d5e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:43.364693 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:41:43.370313 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-abe7190f-c038-4102-90b8-a57a9317d5e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:43.370793 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-abe7190f-c038-4102-90b8-a57a9317d5e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:43.371224 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-abe7190f-c038-4102-90b8-a57a9317d5e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:43.372008 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-abe7190f-c038-4102-90b8-a57a9317d5e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:43.372973 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-abe7190f-c038-4102-90b8-a57a9317d5e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:43.373395 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-abe7190f-c038-4102-90b8-a57a9317d5e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:43.453643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-33367591-14f7-4da0-a710-a0f832e8b663 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:43.461877 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-33367591-14f7-4da0-a710-a0f832e8b663 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1755 microversion: 2.1 time: 0.167080 Aug 17 08:41:43.462443 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 208/415] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:43 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:43.466812 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b40e0260-b15d-4a5e-bff7-bd67b75ce2f1 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:43.467425 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b40e0260-b15d-4a5e-bff7-bd67b75ce2f1 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: 2d939aeb-93a2-4b10-a699-d45ac67dd0f4] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:43.473170 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b40e0260-b15d-4a5e-bff7-bd67b75ce2f1 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:43.473653 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b40e0260-b15d-4a5e-bff7-bd67b75ce2f1 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:43.474076 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b40e0260-b15d-4a5e-bff7-bd67b75ce2f1 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:43.474761 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b40e0260-b15d-4a5e-bff7-bd67b75ce2f1 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:43.475214 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b40e0260-b15d-4a5e-bff7-bd67b75ce2f1 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:43.475665 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b40e0260-b15d-4a5e-bff7-bd67b75ce2f1 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:43.503737 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-abe7190f-c038-4102-90b8-a57a9317d5e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:43.511893 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-abe7190f-c038-4102-90b8-a57a9317d5e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1736 microversion: 2.1 time: 0.153567 Aug 17 08:41:43.512468 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 208/416] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:43 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:41:43.608234 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b40e0260-b15d-4a5e-bff7-bd67b75ce2f1 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:43.615580 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b40e0260-b15d-4a5e-bff7-bd67b75ce2f1 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4" status: 200 len: 1508 microversion: 2.1 time: 0.152190 Aug 17 08:41:43.616133 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 209/417] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:43 2022] GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:43.636100 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-510b2e88-e30e-4c56-81df-4d896821909b tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bad17767-7e59-48f5-8bcd-861bfbcfd3b7", "device": "/dev/sdb"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:41:43.639626 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-510b2e88-e30e-4c56-81df-4d896821909b tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: 2d939aeb-93a2-4b10-a699-d45ac67dd0f4] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:43.645497 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-510b2e88-e30e-4c56-81df-4d896821909b tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:43.645977 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-510b2e88-e30e-4c56-81df-4d896821909b tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:43.646404 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-510b2e88-e30e-4c56-81df-4d896821909b tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:43.647079 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-510b2e88-e30e-4c56-81df-4d896821909b tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:43.647523 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-510b2e88-e30e-4c56-81df-4d896821909b tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:43.647967 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-510b2e88-e30e-4c56-81df-4d896821909b tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:44.032569 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-510b2e88-e30e-4c56-81df-4d896821909b tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "POST /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.400243 Aug 17 08:41:44.036257 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 209/418] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 08:41:43 2022] POST /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4/os-volume_attachments => generated 194 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:41:44.483054 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a882d879-520c-49aa-9b9e-f235a87c9ded tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:44.483675 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a882d879-520c-49aa-9b9e-f235a87c9ded tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:44.490138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a882d879-520c-49aa-9b9e-f235a87c9ded tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:44.490619 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a882d879-520c-49aa-9b9e-f235a87c9ded tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:44.491052 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a882d879-520c-49aa-9b9e-f235a87c9ded tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:44.491830 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a882d879-520c-49aa-9b9e-f235a87c9ded tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:44.492284 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a882d879-520c-49aa-9b9e-f235a87c9ded tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:44.492706 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a882d879-520c-49aa-9b9e-f235a87c9ded tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:44.534921 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-118090d8-509f-46d9-864b-2929984f0b29 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:44.535663 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-118090d8-509f-46d9-864b-2929984f0b29 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:44.537665 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:41:44.543061 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-118090d8-509f-46d9-864b-2929984f0b29 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:44.543551 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-118090d8-509f-46d9-864b-2929984f0b29 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:44.543995 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-118090d8-509f-46d9-864b-2929984f0b29 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:44.544683 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-118090d8-509f-46d9-864b-2929984f0b29 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:44.545132 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-118090d8-509f-46d9-864b-2929984f0b29 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:44.545548 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-118090d8-509f-46d9-864b-2929984f0b29 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:44.638629 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a882d879-520c-49aa-9b9e-f235a87c9ded tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:44.646659 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a882d879-520c-49aa-9b9e-f235a87c9ded tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1755 microversion: 2.1 time: 0.167987 Aug 17 08:41:44.647164 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 210/419] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:44 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:44.675530 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-118090d8-509f-46d9-864b-2929984f0b29 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:44.684319 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-118090d8-509f-46d9-864b-2929984f0b29 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1736 microversion: 2.1 time: 0.153991 Aug 17 08:41:44.685019 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 210/420] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:44 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:41:45.668012 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-da0f53b3-7227-4b0c-a1f4-06ef411ac863 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:45.668616 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-da0f53b3-7227-4b0c-a1f4-06ef411ac863 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:45.675615 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da0f53b3-7227-4b0c-a1f4-06ef411ac863 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:45.677885 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da0f53b3-7227-4b0c-a1f4-06ef411ac863 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:45.678324 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da0f53b3-7227-4b0c-a1f4-06ef411ac863 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:45.679010 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da0f53b3-7227-4b0c-a1f4-06ef411ac863 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:45.679466 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da0f53b3-7227-4b0c-a1f4-06ef411ac863 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:45.679927 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da0f53b3-7227-4b0c-a1f4-06ef411ac863 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:45.704372 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8d9d8c01-9f5a-4b06-9ac8-1a040f9c91c5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:45.705003 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8d9d8c01-9f5a-4b06-9ac8-1a040f9c91c5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:45.712239 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d9d8c01-9f5a-4b06-9ac8-1a040f9c91c5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:45.712712 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d9d8c01-9f5a-4b06-9ac8-1a040f9c91c5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:45.713136 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d9d8c01-9f5a-4b06-9ac8-1a040f9c91c5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:45.714316 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d9d8c01-9f5a-4b06-9ac8-1a040f9c91c5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:45.714757 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d9d8c01-9f5a-4b06-9ac8-1a040f9c91c5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:45.715168 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8d9d8c01-9f5a-4b06-9ac8-1a040f9c91c5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:45.823959 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-da0f53b3-7227-4b0c-a1f4-06ef411ac863 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:45.832234 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-da0f53b3-7227-4b0c-a1f4-06ef411ac863 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1758 microversion: 2.1 time: 0.168051 Aug 17 08:41:45.832811 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 211/421] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:45 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:45.849098 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8d9d8c01-9f5a-4b06-9ac8-1a040f9c91c5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:45.857707 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8d9d8c01-9f5a-4b06-9ac8-1a040f9c91c5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1736 microversion: 2.1 time: 0.157106 Aug 17 08:41:45.858271 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 211/422] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:45 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:41:46.879262 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d981dfc5-d374-4d90-b547-37330b47baa7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:46.879829 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d981dfc5-d374-4d90-b547-37330b47baa7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:46.882126 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:41:46.887408 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d981dfc5-d374-4d90-b547-37330b47baa7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:46.887928 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d981dfc5-d374-4d90-b547-37330b47baa7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:46.888361 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d981dfc5-d374-4d90-b547-37330b47baa7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:46.889040 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d981dfc5-d374-4d90-b547-37330b47baa7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:46.889494 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d981dfc5-d374-4d90-b547-37330b47baa7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:46.889917 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d981dfc5-d374-4d90-b547-37330b47baa7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:47.023806 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d981dfc5-d374-4d90-b547-37330b47baa7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:47.031871 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d981dfc5-d374-4d90-b547-37330b47baa7 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1736 microversion: 2.1 time: 0.156455 Aug 17 08:41:47.032431 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 212/423] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:46 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:48.053195 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b8b647ce-abec-4d94-b515-4fc3486c3855 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:48.053794 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b8b647ce-abec-4d94-b515-4fc3486c3855 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:48.060190 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b8b647ce-abec-4d94-b515-4fc3486c3855 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:48.060663 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b8b647ce-abec-4d94-b515-4fc3486c3855 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:48.061088 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b8b647ce-abec-4d94-b515-4fc3486c3855 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:48.061758 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b8b647ce-abec-4d94-b515-4fc3486c3855 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:48.062198 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b8b647ce-abec-4d94-b515-4fc3486c3855 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:48.062610 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b8b647ce-abec-4d94-b515-4fc3486c3855 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:48.190261 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b8b647ce-abec-4d94-b515-4fc3486c3855 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:48.198018 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b8b647ce-abec-4d94-b515-4fc3486c3855 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1736 microversion: 2.1 time: 0.148691 Aug 17 08:41:48.198574 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 212/424] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:48 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:49.219810 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-14dbb127-faf0-4cf2-8eea-44b7a6f6a962 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:49.220413 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-14dbb127-faf0-4cf2-8eea-44b7a6f6a962 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:49.226824 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14dbb127-faf0-4cf2-8eea-44b7a6f6a962 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:49.227302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14dbb127-faf0-4cf2-8eea-44b7a6f6a962 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:49.227787 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14dbb127-faf0-4cf2-8eea-44b7a6f6a962 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:49.228464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14dbb127-faf0-4cf2-8eea-44b7a6f6a962 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:49.228912 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14dbb127-faf0-4cf2-8eea-44b7a6f6a962 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:49.229331 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14dbb127-faf0-4cf2-8eea-44b7a6f6a962 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:49.354598 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-14dbb127-faf0-4cf2-8eea-44b7a6f6a962 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:49.362747 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-14dbb127-faf0-4cf2-8eea-44b7a6f6a962 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1736 microversion: 2.1 time: 0.147497 Aug 17 08:41:49.363296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 213/425] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:49 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:50.384749 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-7778bcc8-f928-499e-887e-c3c8071d6d41 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:50.385349 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7778bcc8-f928-499e-887e-c3c8071d6d41 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:50.392323 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7778bcc8-f928-499e-887e-c3c8071d6d41 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:50.392784 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7778bcc8-f928-499e-887e-c3c8071d6d41 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:50.393211 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7778bcc8-f928-499e-887e-c3c8071d6d41 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:50.393887 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7778bcc8-f928-499e-887e-c3c8071d6d41 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:50.394333 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7778bcc8-f928-499e-887e-c3c8071d6d41 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:50.394749 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7778bcc8-f928-499e-887e-c3c8071d6d41 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:50.524985 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-7778bcc8-f928-499e-887e-c3c8071d6d41 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:50.532890 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-7778bcc8-f928-499e-887e-c3c8071d6d41 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1736 microversion: 2.1 time: 0.151964 Aug 17 08:41:50.533449 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 213/426] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:50 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:51.555166 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2a902ccc-5a1e-4369-8858-1cb1c199e82b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:51.555789 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-2a902ccc-5a1e-4369-8858-1cb1c199e82b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:51.562631 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2a902ccc-5a1e-4369-8858-1cb1c199e82b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:51.563272 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2a902ccc-5a1e-4369-8858-1cb1c199e82b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:51.563849 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2a902ccc-5a1e-4369-8858-1cb1c199e82b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:51.564733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2a902ccc-5a1e-4369-8858-1cb1c199e82b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:51.565385 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2a902ccc-5a1e-4369-8858-1cb1c199e82b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:51.565841 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2a902ccc-5a1e-4369-8858-1cb1c199e82b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:51.716515 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-2a902ccc-5a1e-4369-8858-1cb1c199e82b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:51.724493 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2a902ccc-5a1e-4369-8858-1cb1c199e82b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1736 microversion: 2.1 time: 0.174011 Aug 17 08:41:51.725054 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 214/427] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:51 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:52.745576 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-effb47c9-7214-465a-99cc-a9a4538047de tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:52.746176 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-effb47c9-7214-465a-99cc-a9a4538047de tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:52.752638 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-effb47c9-7214-465a-99cc-a9a4538047de tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:52.753113 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-effb47c9-7214-465a-99cc-a9a4538047de tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:52.753541 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-effb47c9-7214-465a-99cc-a9a4538047de tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:52.754214 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-effb47c9-7214-465a-99cc-a9a4538047de tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:52.754661 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-effb47c9-7214-465a-99cc-a9a4538047de tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:52.755079 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-effb47c9-7214-465a-99cc-a9a4538047de tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:52.881553 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-effb47c9-7214-465a-99cc-a9a4538047de tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:52.889961 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-effb47c9-7214-465a-99cc-a9a4538047de tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1736 microversion: 2.1 time: 0.148160 Aug 17 08:41:52.890530 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 214/428] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:52 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:53.910336 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-99c43578-e238-4540-9015-09fed229d092 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:53.910935 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-99c43578-e238-4540-9015-09fed229d092 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:53.917414 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-99c43578-e238-4540-9015-09fed229d092 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:53.917889 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-99c43578-e238-4540-9015-09fed229d092 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:53.918323 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-99c43578-e238-4540-9015-09fed229d092 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:53.919803 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-99c43578-e238-4540-9015-09fed229d092 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:53.920252 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-99c43578-e238-4540-9015-09fed229d092 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:53.920669 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-99c43578-e238-4540-9015-09fed229d092 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:54.044919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-99c43578-e238-4540-9015-09fed229d092 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:54.052885 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-99c43578-e238-4540-9015-09fed229d092 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1736 microversion: 2.1 time: 0.146337 Aug 17 08:41:54.053449 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 215/429] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:53 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:55.073652 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5c214948-bb72-4a66-aa81-640ad09f88f0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:55.074253 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5c214948-bb72-4a66-aa81-640ad09f88f0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:55.081478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5c214948-bb72-4a66-aa81-640ad09f88f0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:55.081959 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5c214948-bb72-4a66-aa81-640ad09f88f0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:55.082419 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5c214948-bb72-4a66-aa81-640ad09f88f0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:55.083091 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5c214948-bb72-4a66-aa81-640ad09f88f0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:55.083535 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5c214948-bb72-4a66-aa81-640ad09f88f0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:55.083973 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5c214948-bb72-4a66-aa81-640ad09f88f0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:55.275222 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5c214948-bb72-4a66-aa81-640ad09f88f0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:55.283812 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5c214948-bb72-4a66-aa81-640ad09f88f0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1736 microversion: 2.1 time: 0.213954 Aug 17 08:41:55.284374 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 215/430] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:55 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:56.305366 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-dcf9fde7-eeaa-4f08-9615-ad7b765759d3 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:56.305908 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-dcf9fde7-eeaa-4f08-9615-ad7b765759d3 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:56.312953 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dcf9fde7-eeaa-4f08-9615-ad7b765759d3 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:56.313432 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dcf9fde7-eeaa-4f08-9615-ad7b765759d3 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:56.313862 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dcf9fde7-eeaa-4f08-9615-ad7b765759d3 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:56.314539 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dcf9fde7-eeaa-4f08-9615-ad7b765759d3 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:56.314989 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dcf9fde7-eeaa-4f08-9615-ad7b765759d3 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:56.315406 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dcf9fde7-eeaa-4f08-9615-ad7b765759d3 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:56.444644 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-dcf9fde7-eeaa-4f08-9615-ad7b765759d3 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:56.453067 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-dcf9fde7-eeaa-4f08-9615-ad7b765759d3 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1736 microversion: 2.1 time: 0.151611 Aug 17 08:41:56.453629 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 216/431] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:56 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:57.474186 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0261b0b7-b6a3-41c8-bb25-35c821e4c162 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:57.474781 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0261b0b7-b6a3-41c8-bb25-35c821e4c162 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:57.481792 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0261b0b7-b6a3-41c8-bb25-35c821e4c162 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:57.482255 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0261b0b7-b6a3-41c8-bb25-35c821e4c162 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:57.482675 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0261b0b7-b6a3-41c8-bb25-35c821e4c162 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:57.483342 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0261b0b7-b6a3-41c8-bb25-35c821e4c162 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:57.483801 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0261b0b7-b6a3-41c8-bb25-35c821e4c162 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:57.484212 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0261b0b7-b6a3-41c8-bb25-35c821e4c162 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:57.611231 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0261b0b7-b6a3-41c8-bb25-35c821e4c162 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:57.619007 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0261b0b7-b6a3-41c8-bb25-35c821e4c162 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1736 microversion: 2.1 time: 0.148629 Aug 17 08:41:57.619578 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 216/432] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:57 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:58.640129 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ad7a8291-a9bd-4256-9143-4c246bd14c94 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:58.640759 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ad7a8291-a9bd-4256-9143-4c246bd14c94 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:58.647050 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad7a8291-a9bd-4256-9143-4c246bd14c94 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:58.647524 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad7a8291-a9bd-4256-9143-4c246bd14c94 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:58.647986 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad7a8291-a9bd-4256-9143-4c246bd14c94 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:58.648661 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad7a8291-a9bd-4256-9143-4c246bd14c94 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:58.649104 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad7a8291-a9bd-4256-9143-4c246bd14c94 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:58.649520 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad7a8291-a9bd-4256-9143-4c246bd14c94 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:58.777300 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ad7a8291-a9bd-4256-9143-4c246bd14c94 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:58.787633 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ad7a8291-a9bd-4256-9143-4c246bd14c94 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1736 microversion: 2.1 time: 0.151585 Aug 17 08:41:58.788639 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 217/433] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:58 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:41:59.809600 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b4346ce8-cd25-49df-9636-5f0a230a36e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:41:59.810194 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b4346ce8-cd25-49df-9636-5f0a230a36e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:41:59.816462 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b4346ce8-cd25-49df-9636-5f0a230a36e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:59.816930 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b4346ce8-cd25-49df-9636-5f0a230a36e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:59.817355 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b4346ce8-cd25-49df-9636-5f0a230a36e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:59.818031 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b4346ce8-cd25-49df-9636-5f0a230a36e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:41:59.818468 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b4346ce8-cd25-49df-9636-5f0a230a36e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:41:59.818879 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b4346ce8-cd25-49df-9636-5f0a230a36e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:41:59.946907 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b4346ce8-cd25-49df-9636-5f0a230a36e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:41:59.955473 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b4346ce8-cd25-49df-9636-5f0a230a36e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1736 microversion: 2.1 time: 0.149461 Aug 17 08:41:59.956055 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 217/434] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:41:59 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:00.976659 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-60eae242-96e1-4937-a407-268bd0952c14 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:00.977261 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-60eae242-96e1-4937-a407-268bd0952c14 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:00.984230 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-60eae242-96e1-4937-a407-268bd0952c14 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:00.984706 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-60eae242-96e1-4937-a407-268bd0952c14 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:00.985138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-60eae242-96e1-4937-a407-268bd0952c14 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:00.985814 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-60eae242-96e1-4937-a407-268bd0952c14 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:00.986264 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-60eae242-96e1-4937-a407-268bd0952c14 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:00.986684 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-60eae242-96e1-4937-a407-268bd0952c14 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:01.119809 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-60eae242-96e1-4937-a407-268bd0952c14 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:01.128367 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-60eae242-96e1-4937-a407-268bd0952c14 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1736 microversion: 2.1 time: 0.155605 Aug 17 08:42:01.128929 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 218/435] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:00 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:42:02.149447 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1497e800-83e5-4f0a-83ed-af6808188494 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:02.150043 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1497e800-83e5-4f0a-83ed-af6808188494 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:02.156439 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1497e800-83e5-4f0a-83ed-af6808188494 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:02.156906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1497e800-83e5-4f0a-83ed-af6808188494 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:02.157324 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1497e800-83e5-4f0a-83ed-af6808188494 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:02.157990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1497e800-83e5-4f0a-83ed-af6808188494 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:02.158427 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1497e800-83e5-4f0a-83ed-af6808188494 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:02.158836 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1497e800-83e5-4f0a-83ed-af6808188494 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:02.289059 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1497e800-83e5-4f0a-83ed-af6808188494 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:02.299518 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1497e800-83e5-4f0a-83ed-af6808188494 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1736 microversion: 2.1 time: 0.153894 Aug 17 08:42:02.300388 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 218/436] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:02 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:03.321125 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b6ee9e08-c480-41cb-960a-d55f443aa597 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:03.321756 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b6ee9e08-c480-41cb-960a-d55f443aa597 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:03.328232 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b6ee9e08-c480-41cb-960a-d55f443aa597 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:03.328678 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b6ee9e08-c480-41cb-960a-d55f443aa597 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:03.329000 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b6ee9e08-c480-41cb-960a-d55f443aa597 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:03.329675 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b6ee9e08-c480-41cb-960a-d55f443aa597 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:03.330375 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b6ee9e08-c480-41cb-960a-d55f443aa597 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:03.331021 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b6ee9e08-c480-41cb-960a-d55f443aa597 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:03.346285 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1df9937d-fce3-4d35-a2f5-beca1b27423f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:03.346781 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1df9937d-fce3-4d35-a2f5-beca1b27423f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: 2d939aeb-93a2-4b10-a699-d45ac67dd0f4] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:03.353053 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1df9937d-fce3-4d35-a2f5-beca1b27423f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:03.353529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1df9937d-fce3-4d35-a2f5-beca1b27423f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:03.353960 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1df9937d-fce3-4d35-a2f5-beca1b27423f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:03.354637 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1df9937d-fce3-4d35-a2f5-beca1b27423f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:03.355083 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1df9937d-fce3-4d35-a2f5-beca1b27423f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:03.355500 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1df9937d-fce3-4d35-a2f5-beca1b27423f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:03.435748 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-1df9937d-fce3-4d35-a2f5-beca1b27423f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lazy-loading 'services' on Instance uuid 2d939aeb-93a2-4b10-a699-d45ac67dd0f4 {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:42:03.459942 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b6ee9e08-c480-41cb-960a-d55f443aa597 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:03.467879 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b6ee9e08-c480-41cb-960a-d55f443aa597 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1716 microversion: 2.1 time: 0.150543 Aug 17 08:42:03.468442 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 219/437] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:03 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:03.505843 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1df9937d-fce3-4d35-a2f5-beca1b27423f tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4/os-volume_attachments/bad17767-7e59-48f5-8bcd-861bfbcfd3b7" status: 202 len: 0 microversion: 2.1 time: 0.163250 Aug 17 08:42:03.506717 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 219/438] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 08:42:03 2022] DELETE /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4/os-volume_attachments/bad17767-7e59-48f5-8bcd-861bfbcfd3b7 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 08:42:03.590634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-79c7ef5d-cd22-45ab-a812-7919a9cf35e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:03.591170 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-79c7ef5d-cd22-45ab-a812-7919a9cf35e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:03.597125 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-79c7ef5d-cd22-45ab-a812-7919a9cf35e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:03.597604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-79c7ef5d-cd22-45ab-a812-7919a9cf35e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:03.598024 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-79c7ef5d-cd22-45ab-a812-7919a9cf35e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:03.598703 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-79c7ef5d-cd22-45ab-a812-7919a9cf35e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:03.599192 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-79c7ef5d-cd22-45ab-a812-7919a9cf35e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:03.599854 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-79c7ef5d-cd22-45ab-a812-7919a9cf35e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:03.724067 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-79c7ef5d-cd22-45ab-a812-7919a9cf35e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] HTTP exception thrown: Cannot 'detach_volume' instance 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 while it is in vm_state rescued Aug 17 08:42:03.725652 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-79c7ef5d-cd22-45ab-a812-7919a9cf35e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Request method failure captured: Aug 17 08:42:03.725652 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: DELETE /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1/os-volume_attachments/4ad52f12-454a-4ba3-9218-8a16d667350b HTTP/1.1 Aug 17 08:42:03.725652 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:42:03.725652 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:42:03.725652 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:42:03.725652 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:42:03.725652 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:42:03.725652 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:42:03.725652 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:42:03.725652 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:42:03.725652 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_Kji6Z6va2Uun3O7PfuwZB78DrFVBWntRNdu90xpb_V8I8QwVJ2kvC1hN3MJ79pVctymf4qsZ66__L6U-Av0K3yOggyHXxU1_rw06E-jph23OY_HLUrhK8ayFUMvsxgiYt2c7Y4q-1Au0PC8GFHJjVF0sKN8b-BkvnKkF76FNyXvPfQ Aug 17 08:42:03.725652 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:42:03.725652 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:42:03.725652 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:42:03.725652 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:42:03.725652 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:42:03.725652 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:42:03.725652 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: 2f3596b4a1404d3db340943fbd63567d Aug 17 08:42:03.725652 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-197889665 Aug 17 08:42:03.725652 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:42:03.725652 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:42:03.727262 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2f3596b4a1404d3db340943fbd63567d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2f3596b4a1404d3db340943fbd63567d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2f3596b4a1404d3db340943fbd63567d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2f3596b4a1404d3db340943fbd63567d", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:42:03.727262 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-ServerRescueNegativeTestJSON-197889665 Aug 17 08:42:03.727262 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 2f3596b4a1404d3db340943fbd63567d Aug 17 08:42:03.727262 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-197889665 Aug 17 08:42:03.727262 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-ServerRescueNegativeTestJSON-197889665-project Aug 17 08:42:03.727262 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:42:03.727262 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:42:03.727262 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: f051f99404fc4e0593553ae95e1f90d5 Aug 17 08:42:03.727262 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-ServerRescueNegativeTestJSON-197889665-project Aug 17 08:42:03.727262 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: > Aug 17 08:42:03.727262 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Cannot 'detach_volume' instance 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 while it is in vm_state rescued Aug 17 08:42:03.728074 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'server_id': '9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1', 'id': '4ad52f12-454a-4ba3-9218-8a16d667350b'} Aug 17 08:42:03.728074 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:42:03.728074 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:42:03.728074 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 17 08:42:03.728074 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 17 08:42:03.728074 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 08:42:03.728074 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 08:42:03.728074 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 17 08:42:03.728074 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 17 08:42:03.728074 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 17 08:42:03.728074 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:42:03.728074 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:42:03.728074 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:42:03.728074 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:42:03.728074 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:42:03.728074 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:42:03.728074 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:42:03.728074 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:42:03.728074 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:42:03.728074 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:42:03.729428 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 17 08:42:03.729428 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 17 08:42:03.729428 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 17 08:42:03.729428 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 17 08:42:03.729428 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 while it is in vm_state rescued Aug 17 08:42:03.729428 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:42:03.729428 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:42:03.729428 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:42:03.729428 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:42:03.729428 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:42:03.729428 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:42:03.729428 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:42:03.729428 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:42:03.729428 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 while it is in vm_state rescued Aug 17 08:42:03.729428 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:42:03.729428 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-79c7ef5d-cd22-45ab-a812-7919a9cf35e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Returning 409 to user: Cannot 'detach_volume' instance 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 while it is in vm_state rescued {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:42:03.730418 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-79c7ef5d-cd22-45ab-a812-7919a9cf35e2 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1/os-volume_attachments/4ad52f12-454a-4ba3-9218-8a16d667350b" status: 409 len: 152 microversion: 2.1 time: 0.141179 Aug 17 08:42:03.730418 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 220/439] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 08:42:03 2022] DELETE /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1/os-volume_attachments/4ad52f12-454a-4ba3-9218-8a16d667350b => generated 152 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 17 08:42:03.736999 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-da449a48-be91-406e-8967-3810f25bea25 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:42:03.737612 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-da449a48-be91-406e-8967-3810f25bea25 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:03.743622 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-da449a48-be91-406e-8967-3810f25bea25 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:03.744097 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-da449a48-be91-406e-8967-3810f25bea25 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:03.744524 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-da449a48-be91-406e-8967-3810f25bea25 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:03.745195 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-da449a48-be91-406e-8967-3810f25bea25 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:03.745643 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-da449a48-be91-406e-8967-3810f25bea25 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:03.746059 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-da449a48-be91-406e-8967-3810f25bea25 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:03.809489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-da449a48-be91-406e-8967-3810f25bea25 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "POST /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1/action" status: 202 len: 0 microversion: 2.1 time: 0.076427 Aug 17 08:42:03.813141 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 220/440] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 08:42:03 2022] POST /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:42:03.818172 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-48b47868-1618-408c-8868-eec35c024f9f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:03.818770 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-48b47868-1618-408c-8868-eec35c024f9f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:03.825884 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48b47868-1618-408c-8868-eec35c024f9f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:03.826360 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48b47868-1618-408c-8868-eec35c024f9f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:03.826785 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48b47868-1618-408c-8868-eec35c024f9f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:03.827503 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48b47868-1618-408c-8868-eec35c024f9f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:03.827923 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48b47868-1618-408c-8868-eec35c024f9f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:03.828336 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-48b47868-1618-408c-8868-eec35c024f9f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:03.952944 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-48b47868-1618-408c-8868-eec35c024f9f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:03.961071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-48b47868-1618-408c-8868-eec35c024f9f tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1724 microversion: 2.1 time: 0.146644 Aug 17 08:42:03.961629 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 221/441] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:03 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:04.646749 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-73891ec4-dc7e-4206-be77-beea887104e8 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:04.647929 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-73891ec4-dc7e-4206-be77-beea887104e8 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: 2d939aeb-93a2-4b10-a699-d45ac67dd0f4] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:04.655151 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-73891ec4-dc7e-4206-be77-beea887104e8 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:04.655754 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-73891ec4-dc7e-4206-be77-beea887104e8 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:04.656669 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-73891ec4-dc7e-4206-be77-beea887104e8 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:04.657351 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-73891ec4-dc7e-4206-be77-beea887104e8 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:04.657796 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-73891ec4-dc7e-4206-be77-beea887104e8 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:04.658210 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-73891ec4-dc7e-4206-be77-beea887104e8 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:04.662693 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:42:04.687089 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-73891ec4-dc7e-4206-be77-beea887104e8 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: 2d939aeb-93a2-4b10-a699-d45ac67dd0f4] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 08:42:04.775030 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-73891ec4-dc7e-4206-be77-beea887104e8 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4" status: 204 len: 0 microversion: 2.1 time: 0.132484 Aug 17 08:42:04.775757 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 221/442] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:42:04 2022] DELETE /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 08:42:04.784382 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d4eef603-64f5-4367-ad6e-e11fc384275c tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:04.784972 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d4eef603-64f5-4367-ad6e-e11fc384275c tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: 2d939aeb-93a2-4b10-a699-d45ac67dd0f4] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:04.791416 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d4eef603-64f5-4367-ad6e-e11fc384275c tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:04.791947 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d4eef603-64f5-4367-ad6e-e11fc384275c tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:04.792378 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d4eef603-64f5-4367-ad6e-e11fc384275c tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:04.793095 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d4eef603-64f5-4367-ad6e-e11fc384275c tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:04.793547 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d4eef603-64f5-4367-ad6e-e11fc384275c tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:04.793970 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d4eef603-64f5-4367-ad6e-e11fc384275c tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:04.923345 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d4eef603-64f5-4367-ad6e-e11fc384275c tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:04.930834 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d4eef603-64f5-4367-ad6e-e11fc384275c tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4" status: 200 len: 1514 microversion: 2.1 time: 0.150269 Aug 17 08:42:04.931398 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 222/443] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:04 2022] GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:42:04.982750 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-55736742-cfbf-4fd4-bf11-7b5ff70a10ff tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:04.983430 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-55736742-cfbf-4fd4-bf11-7b5ff70a10ff tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:04.989214 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-55736742-cfbf-4fd4-bf11-7b5ff70a10ff tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:04.989687 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-55736742-cfbf-4fd4-bf11-7b5ff70a10ff tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:04.990118 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-55736742-cfbf-4fd4-bf11-7b5ff70a10ff tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:04.990792 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-55736742-cfbf-4fd4-bf11-7b5ff70a10ff tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:04.991240 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-55736742-cfbf-4fd4-bf11-7b5ff70a10ff tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:04.991679 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-55736742-cfbf-4fd4-bf11-7b5ff70a10ff tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:05.122566 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-55736742-cfbf-4fd4-bf11-7b5ff70a10ff tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:05.130452 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-55736742-cfbf-4fd4-bf11-7b5ff70a10ff tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1724 microversion: 2.1 time: 0.151821 Aug 17 08:42:05.131007 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 222/444] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:04 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:05.950850 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ddc3777e-0802-4777-91df-8513cde6850b tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:05.951451 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ddc3777e-0802-4777-91df-8513cde6850b tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: 2d939aeb-93a2-4b10-a699-d45ac67dd0f4] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:05.958069 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ddc3777e-0802-4777-91df-8513cde6850b tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:05.958542 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ddc3777e-0802-4777-91df-8513cde6850b tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:05.958970 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ddc3777e-0802-4777-91df-8513cde6850b tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:05.959678 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ddc3777e-0802-4777-91df-8513cde6850b tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:05.960129 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ddc3777e-0802-4777-91df-8513cde6850b tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:05.960548 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ddc3777e-0802-4777-91df-8513cde6850b tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:06.085922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ddc3777e-0802-4777-91df-8513cde6850b tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:06.093885 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ddc3777e-0802-4777-91df-8513cde6850b tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4" status: 200 len: 1514 microversion: 2.1 time: 0.146929 Aug 17 08:42:06.094503 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 223/445] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:05 2022] GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:42:06.151889 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a7cdcfbe-00a0-4f77-8bd2-dc6deee729d3 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:06.152993 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a7cdcfbe-00a0-4f77-8bd2-dc6deee729d3 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:06.159639 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a7cdcfbe-00a0-4f77-8bd2-dc6deee729d3 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:06.160113 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a7cdcfbe-00a0-4f77-8bd2-dc6deee729d3 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:06.160540 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a7cdcfbe-00a0-4f77-8bd2-dc6deee729d3 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:06.161217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a7cdcfbe-00a0-4f77-8bd2-dc6deee729d3 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:06.161664 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a7cdcfbe-00a0-4f77-8bd2-dc6deee729d3 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:06.162079 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a7cdcfbe-00a0-4f77-8bd2-dc6deee729d3 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:06.286781 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a7cdcfbe-00a0-4f77-8bd2-dc6deee729d3 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:06.294602 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a7cdcfbe-00a0-4f77-8bd2-dc6deee729d3 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1724 microversion: 2.1 time: 0.146502 Aug 17 08:42:06.295161 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 223/446] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:06 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:07.115485 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d6f652e1-5a3a-42e3-aa2f-deeb31b49d74 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:07.116116 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d6f652e1-5a3a-42e3-aa2f-deeb31b49d74 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: 2d939aeb-93a2-4b10-a699-d45ac67dd0f4] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:07.122593 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d6f652e1-5a3a-42e3-aa2f-deeb31b49d74 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:07.123072 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d6f652e1-5a3a-42e3-aa2f-deeb31b49d74 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:07.123508 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d6f652e1-5a3a-42e3-aa2f-deeb31b49d74 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:07.124212 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d6f652e1-5a3a-42e3-aa2f-deeb31b49d74 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:07.124662 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d6f652e1-5a3a-42e3-aa2f-deeb31b49d74 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:07.125084 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d6f652e1-5a3a-42e3-aa2f-deeb31b49d74 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:07.253266 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d6f652e1-5a3a-42e3-aa2f-deeb31b49d74 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:07.260653 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d6f652e1-5a3a-42e3-aa2f-deeb31b49d74 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4" status: 200 len: 1514 microversion: 2.1 time: 0.149033 Aug 17 08:42:07.261236 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 224/447] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:07 2022] GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:07.314894 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e95edd55-5060-4512-bcf6-e2f3eba51850 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:07.315560 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e95edd55-5060-4512-bcf6-e2f3eba51850 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:07.321866 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e95edd55-5060-4512-bcf6-e2f3eba51850 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:07.322340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e95edd55-5060-4512-bcf6-e2f3eba51850 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:07.322766 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e95edd55-5060-4512-bcf6-e2f3eba51850 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:07.323439 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e95edd55-5060-4512-bcf6-e2f3eba51850 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:07.323912 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e95edd55-5060-4512-bcf6-e2f3eba51850 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:07.324835 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e95edd55-5060-4512-bcf6-e2f3eba51850 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:07.454409 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e95edd55-5060-4512-bcf6-e2f3eba51850 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:07.462523 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e95edd55-5060-4512-bcf6-e2f3eba51850 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1724 microversion: 2.1 time: 0.151472 Aug 17 08:42:07.463082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 224/448] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:07 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:08.282197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e7d10fb6-8b64-4180-85af-ae2ae7f5f845 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:08.283648 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e7d10fb6-8b64-4180-85af-ae2ae7f5f845 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: 2d939aeb-93a2-4b10-a699-d45ac67dd0f4] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:08.289699 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e7d10fb6-8b64-4180-85af-ae2ae7f5f845 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:08.290179 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e7d10fb6-8b64-4180-85af-ae2ae7f5f845 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:08.290603 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e7d10fb6-8b64-4180-85af-ae2ae7f5f845 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:08.291284 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e7d10fb6-8b64-4180-85af-ae2ae7f5f845 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:08.291762 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e7d10fb6-8b64-4180-85af-ae2ae7f5f845 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:08.292178 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e7d10fb6-8b64-4180-85af-ae2ae7f5f845 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:08.296805 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=100 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:42:08.354567 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e7d10fb6-8b64-4180-85af-ae2ae7f5f845 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:08.363023 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e7d10fb6-8b64-4180-85af-ae2ae7f5f845 tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4" status: 200 len: 1472 microversion: 2.1 time: 0.084723 Aug 17 08:42:08.364354 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 225/449] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:08 2022] GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4 => generated 1472 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:08.432744 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-041b897f-f005-4bc9-9aca-1eb014e9adaa req-a7567425-a62d-4d46-bb16-d1c38e70bb0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d939aeb-93a2-4b10-a699-d45ac67dd0f4", "name": "network-vif-deleted", "tag": "43b90ab5-c802-4901-b5c4-68ce23827175"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:42:08.442515 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-041b897f-f005-4bc9-9aca-1eb014e9adaa req-a7567425-a62d-4d46-bb16-d1c38e70bb0e service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:08.442981 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-041b897f-f005-4bc9-9aca-1eb014e9adaa req-a7567425-a62d-4d46-bb16-d1c38e70bb0e service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:08.443401 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-041b897f-f005-4bc9-9aca-1eb014e9adaa req-a7567425-a62d-4d46-bb16-d1c38e70bb0e service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:08.454147 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-041b897f-f005-4bc9-9aca-1eb014e9adaa req-a7567425-a62d-4d46-bb16-d1c38e70bb0e service nova] Creating event network-vif-deleted:43b90ab5-c802-4901-b5c4-68ce23827175 for instance 2d939aeb-93a2-4b10-a699-d45ac67dd0f4 on hv-cinder-85331 Aug 17 08:42:08.458984 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-041b897f-f005-4bc9-9aca-1eb014e9adaa req-a7567425-a62d-4d46-bb16-d1c38e70bb0e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029855 Aug 17 08:42:08.459562 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 225/450] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:42:08.484110 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2b69fd2f-35fb-4d0c-9405-f65b8a589de8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:08.484708 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-2b69fd2f-35fb-4d0c-9405-f65b8a589de8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:08.490701 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2b69fd2f-35fb-4d0c-9405-f65b8a589de8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:08.491181 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2b69fd2f-35fb-4d0c-9405-f65b8a589de8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:08.491645 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2b69fd2f-35fb-4d0c-9405-f65b8a589de8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:08.492325 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2b69fd2f-35fb-4d0c-9405-f65b8a589de8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:08.492775 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2b69fd2f-35fb-4d0c-9405-f65b8a589de8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:08.493194 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2b69fd2f-35fb-4d0c-9405-f65b8a589de8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:08.621770 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-2b69fd2f-35fb-4d0c-9405-f65b8a589de8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:08.629594 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2b69fd2f-35fb-4d0c-9405-f65b8a589de8 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1730 microversion: 2.1 time: 0.149959 Aug 17 08:42:08.630145 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 226/451] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:08 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:08.650693 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ca3aa9c4-86a0-45ec-9538-4e91508332af tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:08.651258 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ca3aa9c4-86a0-45ec-9538-4e91508332af tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:08.658064 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca3aa9c4-86a0-45ec-9538-4e91508332af tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:08.658536 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca3aa9c4-86a0-45ec-9538-4e91508332af tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:08.658966 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca3aa9c4-86a0-45ec-9538-4e91508332af tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:08.659670 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca3aa9c4-86a0-45ec-9538-4e91508332af tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:08.660117 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca3aa9c4-86a0-45ec-9538-4e91508332af tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:08.660584 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca3aa9c4-86a0-45ec-9538-4e91508332af tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:08.736769 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ca3aa9c4-86a0-45ec-9538-4e91508332af tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090235 Aug 17 08:42:08.737360 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 226/452] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 17 08:42:08 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:42:09.384606 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-da1ba753-17e3-4c53-b8c3-1441505b80fd tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:09.385200 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-da1ba753-17e3-4c53-b8c3-1441505b80fd tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: 2d939aeb-93a2-4b10-a699-d45ac67dd0f4] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:09.391829 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da1ba753-17e3-4c53-b8c3-1441505b80fd tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:09.392296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da1ba753-17e3-4c53-b8c3-1441505b80fd tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:09.392715 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da1ba753-17e3-4c53-b8c3-1441505b80fd tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:09.393391 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da1ba753-17e3-4c53-b8c3-1441505b80fd tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:09.393999 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da1ba753-17e3-4c53-b8c3-1441505b80fd tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:09.394566 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da1ba753-17e3-4c53-b8c3-1441505b80fd tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:09.427470 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da1ba753-17e3-4c53-b8c3-1441505b80fd tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:09.428136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da1ba753-17e3-4c53-b8c3-1441505b80fd tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:09.428728 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da1ba753-17e3-4c53-b8c3-1441505b80fd tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:09.429230 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.objects.instance [None req-da1ba753-17e3-4c53-b8c3-1441505b80fd tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lazy-loading 'fault' on Instance uuid 2d939aeb-93a2-4b10-a699-d45ac67dd0f4 {{(pid=127297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:42:09.509282 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-da1ba753-17e3-4c53-b8c3-1441505b80fd tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a21876665f41c181a033dce1b0cea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c20360aec7a4d60b7260305ab7e1b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:09.516548 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-da1ba753-17e3-4c53-b8c3-1441505b80fd tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4" status: 200 len: 1309 microversion: 2.1 time: 0.135252 Aug 17 08:42:09.516548 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 227/453] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:09 2022] GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4 => generated 1309 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:10.002529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-fba83259-c5e0-4b46-bbb8-995361e2182b req-81b84f37-d070-4031-9623-46387ac5fa96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1", "tag": "07a04b7d-775b-4a78-95c5-7fe56d001b03"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:42:10.016189 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-fba83259-c5e0-4b46-bbb8-995361e2182b req-81b84f37-d070-4031-9623-46387ac5fa96 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:10.016902 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-fba83259-c5e0-4b46-bbb8-995361e2182b req-81b84f37-d070-4031-9623-46387ac5fa96 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:10.017493 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-fba83259-c5e0-4b46-bbb8-995361e2182b req-81b84f37-d070-4031-9623-46387ac5fa96 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:10.029820 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-fba83259-c5e0-4b46-bbb8-995361e2182b req-81b84f37-d070-4031-9623-46387ac5fa96 service nova] Creating event network-changed:07a04b7d-775b-4a78-95c5-7fe56d001b03 for instance 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 on hv-cinder-85331 Aug 17 08:42:10.034600 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-fba83259-c5e0-4b46-bbb8-995361e2182b req-81b84f37-d070-4031-9623-46387ac5fa96 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036188 Aug 17 08:42:10.035180 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 227/454] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:42:10.536725 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-cafa41ff-1bf5-4242-93c3-b8e286f6878a tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:10.537695 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-cafa41ff-1bf5-4242-93c3-b8e286f6878a tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] [instance: 2d939aeb-93a2-4b10-a699-d45ac67dd0f4] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:10.544418 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cafa41ff-1bf5-4242-93c3-b8e286f6878a tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:10.544895 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cafa41ff-1bf5-4242-93c3-b8e286f6878a tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:10.545321 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cafa41ff-1bf5-4242-93c3-b8e286f6878a tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:10.546003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cafa41ff-1bf5-4242-93c3-b8e286f6878a tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:10.546875 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cafa41ff-1bf5-4242-93c3-b8e286f6878a tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:10.546875 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cafa41ff-1bf5-4242-93c3-b8e286f6878a tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:10.561094 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-cafa41ff-1bf5-4242-93c3-b8e286f6878a tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] HTTP exception thrown: Instance 2d939aeb-93a2-4b10-a699-d45ac67dd0f4 could not be found. Aug 17 08:42:10.562634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-cafa41ff-1bf5-4242-93c3-b8e286f6878a tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Request method failure captured: Aug 17 08:42:10.562634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4 HTTP/1.1 Aug 17 08:42:10.562634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:42:10.562634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:42:10.562634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:42:10.562634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:42:10.562634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:42:10.562634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:42:10.562634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:42:10.562634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:42:10.562634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_KlhNmO-nqIRIWuBqjJhfP1sK8QVhqIKIdIgXdXB7pVpjkcles-bFFMHCzLZpbYSOOq2AePkPy-L7c22tPfKq5cbyS2X-XWtKvkLo3-RA_OX4NGnZie6c9YP0z2Zo9kKXjlvt75B1a2zVX3SLxgkb_HnXyZ5r4Neczf7-vI5u-9LcAw Aug 17 08:42:10.562634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:42:10.562634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:42:10.562634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:42:10.562634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:42:10.562634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:42:10.562634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:42:10.562634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: 4c20360aec7a4d60b7260305ab7e1b2f Aug 17 08:42:10.562634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-VolumesSnapshotTestJSON-429957818 Aug 17 08:42:10.562634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:42:10.562634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:42:10.564100 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4c20360aec7a4d60b7260305ab7e1b2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4c20360aec7a4d60b7260305ab7e1b2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4c20360aec7a4d60b7260305ab7e1b2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4c20360aec7a4d60b7260305ab7e1b2f", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:42:10.564100 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-VolumesSnapshotTestJSON-429957818 Aug 17 08:42:10.564100 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 4c20360aec7a4d60b7260305ab7e1b2f Aug 17 08:42:10.564100 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-429957818 Aug 17 08:42:10.564100 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-VolumesSnapshotTestJSON-429957818-project Aug 17 08:42:10.564100 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:42:10.564100 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:42:10.564100 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: 75a21876665f41c181a033dce1b0cea2 Aug 17 08:42:10.564100 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-VolumesSnapshotTestJSON-429957818-project Aug 17 08:42:10.564100 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: > Aug 17 08:42:10.564100 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Instance 2d939aeb-93a2-4b10-a699-d45ac67dd0f4 could not be found. Aug 17 08:42:10.564100 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': '2d939aeb-93a2-4b10-a699-d45ac67dd0f4'} Aug 17 08:42:10.564899 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:42:10.564899 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:42:10.564899 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:42:10.564899 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:42:10.564899 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:42:10.564899 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:42:10.564899 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:42:10.564899 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:42:10.564899 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:42:10.564899 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:42:10.564899 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d939aeb-93a2-4b10-a699-d45ac67dd0f4 could not be found. Aug 17 08:42:10.564899 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:42:10.564899 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:42:10.564899 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:42:10.564899 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:42:10.564899 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:42:10.564899 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:42:10.564899 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:42:10.564899 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:42:10.564899 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:42:10.566132 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:42:10.566132 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:42:10.566132 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:42:10.566132 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:42:10.566132 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:42:10.566132 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:42:10.566132 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:42:10.566132 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d939aeb-93a2-4b10-a699-d45ac67dd0f4 could not be found. Aug 17 08:42:10.566132 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:42:10.566132 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:42:10.566132 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:42:10.566132 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:42:10.566132 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:42:10.566132 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:42:10.566132 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:42:10.566132 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:42:10.566132 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d939aeb-93a2-4b10-a699-d45ac67dd0f4 could not be found. Aug 17 08:42:10.566132 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:42:10.567351 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-cafa41ff-1bf5-4242-93c3-b8e286f6878a tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] Returning 404 to user: Instance 2d939aeb-93a2-4b10-a699-d45ac67dd0f4 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:42:10.567351 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-cafa41ff-1bf5-4242-93c3-b8e286f6878a tempest-VolumesSnapshotTestJSON-429957818 tempest-VolumesSnapshotTestJSON-429957818-project] 10.222.0.15 "GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4" status: 404 len: 111 microversion: 2.1 time: 0.031174 Aug 17 08:42:10.567351 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 228/455] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:10 2022] GET /compute/v2.1/servers/2d939aeb-93a2-4b10-a699-d45ac67dd0f4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:42:12.051816 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-490129cf-39e0-4f0d-b0a1-2318e2518116 req-d7e8b699-67dd-494c-84bf-b0fc3746e538 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1", "tag": "07a04b7d-775b-4a78-95c5-7fe56d001b03"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:42:12.062891 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-490129cf-39e0-4f0d-b0a1-2318e2518116 req-d7e8b699-67dd-494c-84bf-b0fc3746e538 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:12.063368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-490129cf-39e0-4f0d-b0a1-2318e2518116 req-d7e8b699-67dd-494c-84bf-b0fc3746e538 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:12.063813 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-490129cf-39e0-4f0d-b0a1-2318e2518116 req-d7e8b699-67dd-494c-84bf-b0fc3746e538 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:12.074983 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-490129cf-39e0-4f0d-b0a1-2318e2518116 req-d7e8b699-67dd-494c-84bf-b0fc3746e538 service nova] Creating event network-changed:07a04b7d-775b-4a78-95c5-7fe56d001b03 for instance 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 on hv-cinder-85331 Aug 17 08:42:12.080405 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-490129cf-39e0-4f0d-b0a1-2318e2518116 req-d7e8b699-67dd-494c-84bf-b0fc3746e538 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033713 Aug 17 08:42:12.080971 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 228/456] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:42:15.223710 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-fb349f8c-0f86-4c77-bb7a-35efd0378591 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:15.225946 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fb349f8c-0f86-4c77-bb7a-35efd0378591 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:15.233091 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fb349f8c-0f86-4c77-bb7a-35efd0378591 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:15.233569 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fb349f8c-0f86-4c77-bb7a-35efd0378591 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:15.233994 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fb349f8c-0f86-4c77-bb7a-35efd0378591 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:15.234672 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fb349f8c-0f86-4c77-bb7a-35efd0378591 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:15.235120 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fb349f8c-0f86-4c77-bb7a-35efd0378591 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:15.235551 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fb349f8c-0f86-4c77-bb7a-35efd0378591 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:15.263912 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-fb349f8c-0f86-4c77-bb7a-35efd0378591 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044183 Aug 17 08:42:15.264463 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 229/457] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 08:42:15 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 08:42:15.326738 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-733672cf-6226-45a7-9aa4-066d9bfb4d7b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:15.327302 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-733672cf-6226-45a7-9aa4-066d9bfb4d7b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:15.329372 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:42:15.335637 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-733672cf-6226-45a7-9aa4-066d9bfb4d7b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:15.336111 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-733672cf-6226-45a7-9aa4-066d9bfb4d7b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:15.336538 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-733672cf-6226-45a7-9aa4-066d9bfb4d7b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:15.337297 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-733672cf-6226-45a7-9aa4-066d9bfb4d7b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:15.337836 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-733672cf-6226-45a7-9aa4-066d9bfb4d7b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:15.338400 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-733672cf-6226-45a7-9aa4-066d9bfb4d7b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:15.367507 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-733672cf-6226-45a7-9aa4-066d9bfb4d7b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 08:42:15.460459 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-733672cf-6226-45a7-9aa4-066d9bfb4d7b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 204 len: 0 microversion: 2.1 time: 0.137814 Aug 17 08:42:15.461330 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 229/458] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:42:15 2022] DELETE /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 08:42:15.469840 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-dc2c199a-0ecb-4a5d-9ffc-0dfd839d7c68 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:15.470438 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-dc2c199a-0ecb-4a5d-9ffc-0dfd839d7c68 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:15.476340 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dc2c199a-0ecb-4a5d-9ffc-0dfd839d7c68 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:15.477108 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dc2c199a-0ecb-4a5d-9ffc-0dfd839d7c68 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:15.477239 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dc2c199a-0ecb-4a5d-9ffc-0dfd839d7c68 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:15.477914 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dc2c199a-0ecb-4a5d-9ffc-0dfd839d7c68 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:15.478361 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dc2c199a-0ecb-4a5d-9ffc-0dfd839d7c68 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:15.478780 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dc2c199a-0ecb-4a5d-9ffc-0dfd839d7c68 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:15.611859 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-dc2c199a-0ecb-4a5d-9ffc-0dfd839d7c68 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:15.619289 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-dc2c199a-0ecb-4a5d-9ffc-0dfd839d7c68 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1673 microversion: 2.1 time: 0.153715 Aug 17 08:42:15.619865 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 230/459] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:15 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:16.643714 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-7eab00ea-7327-4607-b783-fa7087f0681b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:16.644463 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7eab00ea-7327-4607-b783-fa7087f0681b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:16.656315 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7eab00ea-7327-4607-b783-fa7087f0681b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:16.656919 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7eab00ea-7327-4607-b783-fa7087f0681b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:16.657517 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7eab00ea-7327-4607-b783-fa7087f0681b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:16.658432 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7eab00ea-7327-4607-b783-fa7087f0681b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:16.659111 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7eab00ea-7327-4607-b783-fa7087f0681b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:16.660454 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7eab00ea-7327-4607-b783-fa7087f0681b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:16.792748 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-7eab00ea-7327-4607-b783-fa7087f0681b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:16.800189 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-7eab00ea-7327-4607-b783-fa7087f0681b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1673 microversion: 2.1 time: 0.163007 Aug 17 08:42:16.800747 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 230/460] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:16 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:17.821428 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-46af4f20-5bac-4840-b46c-24dbe0118538 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:17.822107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-46af4f20-5bac-4840-b46c-24dbe0118538 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:17.824440 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=40 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:42:17.830511 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-46af4f20-5bac-4840-b46c-24dbe0118538 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:17.830995 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-46af4f20-5bac-4840-b46c-24dbe0118538 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:17.831429 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-46af4f20-5bac-4840-b46c-24dbe0118538 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:17.832152 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-46af4f20-5bac-4840-b46c-24dbe0118538 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:17.832604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-46af4f20-5bac-4840-b46c-24dbe0118538 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:17.833029 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-46af4f20-5bac-4840-b46c-24dbe0118538 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:17.978903 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-46af4f20-5bac-4840-b46c-24dbe0118538 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:17.986551 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-46af4f20-5bac-4840-b46c-24dbe0118538 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1673 microversion: 2.1 time: 0.168838 Aug 17 08:42:17.987131 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 231/461] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:17 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:19.007621 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9c7a5f57-0425-4f2c-acb2-02260a0fe3b1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:19.008368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9c7a5f57-0425-4f2c-acb2-02260a0fe3b1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:19.015757 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9c7a5f57-0425-4f2c-acb2-02260a0fe3b1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:19.016246 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9c7a5f57-0425-4f2c-acb2-02260a0fe3b1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:19.016670 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9c7a5f57-0425-4f2c-acb2-02260a0fe3b1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:19.017370 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9c7a5f57-0425-4f2c-acb2-02260a0fe3b1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:19.017889 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9c7a5f57-0425-4f2c-acb2-02260a0fe3b1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:19.018371 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9c7a5f57-0425-4f2c-acb2-02260a0fe3b1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:19.070163 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-2927f698-ac29-437b-8458-9c6c023f65bf req-308194ee-318c-40d8-a61e-e7ad48f7f61c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c224c091-7aa6-49a0-b269-a833010f6cc9", "name": "network-vif-deleted", "tag": "6b201d95-6d5e-4e67-84ac-5b8cfa9080cd"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:42:19.089896 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-2927f698-ac29-437b-8458-9c6c023f65bf req-308194ee-318c-40d8-a61e-e7ad48f7f61c service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:19.090357 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-2927f698-ac29-437b-8458-9c6c023f65bf req-308194ee-318c-40d8-a61e-e7ad48f7f61c service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:19.090818 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-2927f698-ac29-437b-8458-9c6c023f65bf req-308194ee-318c-40d8-a61e-e7ad48f7f61c service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:19.101774 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-9c7a5f57-0425-4f2c-acb2-02260a0fe3b1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:19.107109 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-2927f698-ac29-437b-8458-9c6c023f65bf req-308194ee-318c-40d8-a61e-e7ad48f7f61c service nova] Creating event network-vif-deleted:6b201d95-6d5e-4e67-84ac-5b8cfa9080cd for instance c224c091-7aa6-49a0-b269-a833010f6cc9 on hv-cinder-85331 Aug 17 08:42:19.109441 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9c7a5f57-0425-4f2c-acb2-02260a0fe3b1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 200 len: 1606 microversion: 2.1 time: 0.105782 Aug 17 08:42:19.113481 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 231/462] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:19 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 1606 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:19.123620 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-2927f698-ac29-437b-8458-9c6c023f65bf req-308194ee-318c-40d8-a61e-e7ad48f7f61c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056657 Aug 17 08:42:19.127851 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 232/463] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:42:20.131878 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c080809e-ddaa-4ffa-96b9-a74220640b20 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:20.132583 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c080809e-ddaa-4ffa-96b9-a74220640b20 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:20.140002 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c080809e-ddaa-4ffa-96b9-a74220640b20 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:20.140484 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c080809e-ddaa-4ffa-96b9-a74220640b20 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:20.140919 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c080809e-ddaa-4ffa-96b9-a74220640b20 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:20.141610 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c080809e-ddaa-4ffa-96b9-a74220640b20 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:20.142067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c080809e-ddaa-4ffa-96b9-a74220640b20 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:20.142486 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c080809e-ddaa-4ffa-96b9-a74220640b20 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:20.158999 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-c080809e-ddaa-4ffa-96b9-a74220640b20 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] HTTP exception thrown: Instance c224c091-7aa6-49a0-b269-a833010f6cc9 could not be found. Aug 17 08:42:20.160711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c080809e-ddaa-4ffa-96b9-a74220640b20 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Request method failure captured: Aug 17 08:42:20.160711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 HTTP/1.1 Aug 17 08:42:20.160711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:42:20.160711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:42:20.160711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:42:20.160711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:42:20.160711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:42:20.160711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:42:20.160711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:42:20.160711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:42:20.160711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_KjiKWJZjWgNbqmM28Vjeu9R6ZeIg5FUJHEdYYZsokkrIlIQwAPOg76kV16_SM9dgrm4x4Ey7Bv5JK8yPNlJwFgI2TgzaNGCXIKf-RoVGXcv-LXAgcfo4Z6IqpCOKy8uSUOrF5FFN1LyukP3O_Z1I_aP4J27HRvibpbPvmhWPu10h-k Aug 17 08:42:20.160711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:42:20.160711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:42:20.160711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:42:20.160711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:42:20.160711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:42:20.160711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:42:20.160711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: 458a894213fa47d78568eefbb75f05b3 Aug 17 08:42:20.160711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeTestJSON-2031567907 Aug 17 08:42:20.160711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:42:20.160711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:42:20.162390 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/458a894213fa47d78568eefbb75f05b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/458a894213fa47d78568eefbb75f05b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/458a894213fa47d78568eefbb75f05b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_458a894213fa47d78568eefbb75f05b3", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:42:20.162390 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeTestJSON-2031567907 Aug 17 08:42:20.162390 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 458a894213fa47d78568eefbb75f05b3 Aug 17 08:42:20.162390 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2031567907 Aug 17 08:42:20.162390 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeTestJSON-2031567907-project Aug 17 08:42:20.162390 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:42:20.162390 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:42:20.162390 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: d0aea5553e1043889571c50c3b01cacc Aug 17 08:42:20.162390 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeTestJSON-2031567907-project Aug 17 08:42:20.162390 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:42:20.162390 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Instance c224c091-7aa6-49a0-b269-a833010f6cc9 could not be found. Aug 17 08:42:20.162390 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'id': 'c224c091-7aa6-49a0-b269-a833010f6cc9'} Aug 17 08:42:20.163993 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:42:20.163993 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:42:20.163993 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:42:20.163993 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:42:20.163993 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:42:20.163993 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:42:20.163993 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:42:20.163993 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:42:20.163993 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:42:20.163993 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:42:20.163993 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c224c091-7aa6-49a0-b269-a833010f6cc9 could not be found. Aug 17 08:42:20.163993 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:42:20.163993 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:42:20.163993 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:42:20.163993 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:42:20.163993 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:42:20.163993 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:42:20.163993 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:42:20.163993 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:42:20.163993 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:42:20.165525 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:42:20.165525 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:42:20.165525 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:42:20.165525 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:42:20.165525 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:42:20.165525 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:42:20.165525 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:42:20.165525 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c224c091-7aa6-49a0-b269-a833010f6cc9 could not be found. Aug 17 08:42:20.165525 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:42:20.165525 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:42:20.165525 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:42:20.165525 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:42:20.165525 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:42:20.165525 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:42:20.165525 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:42:20.165525 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:42:20.165525 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c224c091-7aa6-49a0-b269-a833010f6cc9 could not be found. Aug 17 08:42:20.165525 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:42:20.167855 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c080809e-ddaa-4ffa-96b9-a74220640b20 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Returning 404 to user: Instance c224c091-7aa6-49a0-b269-a833010f6cc9 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:42:20.168703 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c080809e-ddaa-4ffa-96b9-a74220640b20 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 404 len: 111 microversion: 2.1 time: 0.040843 Aug 17 08:42:20.169262 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 232/464] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:20 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:42:20.178880 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-499c21f5-d912-4df2-91ac-87528b75cd6c tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '.version_select at 0x7f3f85fda820>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:20.198771 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-499c21f5-d912-4df2-91ac-87528b75cd6c tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-374040571" status: 202 len: 0 microversion: 2.1 time: 0.024582 Aug 17 08:42:20.199413 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 233/465] 10.222.0.15 () {58 vars in 1218 bytes} [Wed Aug 17 08:42:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-374040571 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:42:20.853871 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e7ce00ed-7fed-41a8-bdb6-a56b85c0c9cb tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Action: 'create', calling method: .version_select at 0x7f3f85306b80>, body: {"keypair": {"name": "tempest-keypair-1320256942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFeCCEq1CoKMhDI9B8E6wzV1iSJnUGDqs7XJrpB6pLdxdXrvSYqcQbHOkqjyn0X4X/ey05QMleu9IxdBOfjkyYpnGq2b49FPNLlHUSTTnsKJhQYHeuCy25j9II36aGdQw=="}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:42:20.869640 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-e7ce00ed-7fed-41a8-bdb6-a56b85c0c9cb tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Getting quotas for project 458a894213fa47d78568eefbb75f05b3. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:42:20.873391 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-e7ce00ed-7fed-41a8-bdb6-a56b85c0c9cb tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Getting quotas for user d0aea5553e1043889571c50c3b01cacc and project 458a894213fa47d78568eefbb75f05b3. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:42:20.884699 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e7ce00ed-7fed-41a8-bdb6-a56b85c0c9cb tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [6abe8ac4-d22c-4546-b9e5-5b3fc64ff81d] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 17 08:42:21.892601 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO oslo.messaging._drivers.impl_rabbit [None req-e7ce00ed-7fed-41a8-bdb6-a56b85c0c9cb tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [6abe8ac4-d22c-4546-b9e5-5b3fc64ff81d] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 53332. Aug 17 08:42:21.907114 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e7ce00ed-7fed-41a8-bdb6-a56b85c0c9cb tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.057108 Aug 17 08:42:21.907737 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 233/466] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 08:42:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:42:23.136317 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ad86ff81-104c-4415-866c-38501320e683 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-334839011", "imageRef": "4467450c-a35c-42e3-af85-a13291b0b2aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c245bd1-04fc-4f54-88af-8bb12d32f7ee"}], "security_groups": [{"name": "tempest-securitygroup--473723809"}], "key_name": "tempest-keypair-1320256942", "user_data": "}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:42:23.238279 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.network.neutron [None req-ad86ff81-104c-4415-866c-38501320e683 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] validate_networks() for [('8c245bd1-04fc-4f54-88af-8bb12d32f7ee', None, None, None, None, None)] {{(pid=127297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 08:42:23.604675 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-ad86ff81-104c-4415-866c-38501320e683 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Flavor limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 08:42:23.605089 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-ad86ff81-104c-4415-866c-38501320e683 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Image limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 08:42:23.605553 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-ad86ff81-104c-4415-866c-38501320e683 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Flavor pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 08:42:23.605949 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-ad86ff81-104c-4415-866c-38501320e683 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Image pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 08:42:23.606374 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-ad86ff81-104c-4415-866c-38501320e683 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 08:42:23.615078 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad86ff81-104c-4415-866c-38501320e683 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:23.615565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad86ff81-104c-4415-866c-38501320e683 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:23.616009 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad86ff81-104c-4415-866c-38501320e683 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:23.616711 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad86ff81-104c-4415-866c-38501320e683 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:23.617153 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad86ff81-104c-4415-866c-38501320e683 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:23.617565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ad86ff81-104c-4415-866c-38501320e683 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:23.636616 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-ad86ff81-104c-4415-866c-38501320e683 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Getting quotas for project 458a894213fa47d78568eefbb75f05b3. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:42:23.641082 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-ad86ff81-104c-4415-866c-38501320e683 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Getting quotas for user d0aea5553e1043889571c50c3b01cacc and project 458a894213fa47d78568eefbb75f05b3. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:42:23.653201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ad86ff81-104c-4415-866c-38501320e683 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Going to run 1 instances... {{(pid=127297) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 08:42:23.655552 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ad86ff81-104c-4415-866c-38501320e683 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4467450c-a35c-42e3-af85-a13291b0b2aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 08:42:23.699912 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ad86ff81-104c-4415-866c-38501320e683 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.568381 Aug 17 08:42:23.701381 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 234/467] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 08:42:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 08:42:23.712448 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b2fbeca3-0f2d-4ef7-8719-b50d759002b3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:23.713810 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b2fbeca3-0f2d-4ef7-8719-b50d759002b3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:23.779203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b2fbeca3-0f2d-4ef7-8719-b50d759002b3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:23.786977 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b2fbeca3-0f2d-4ef7-8719-b50d759002b3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2" status: 200 len: 1237 microversion: 2.1 time: 0.078836 Aug 17 08:42:23.787530 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 234/468] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:23 2022] GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2 => generated 1237 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:24.807702 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e0d590e3-22a5-4379-8dea-e17d963554c7 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:24.808324 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e0d590e3-22a5-4379-8dea-e17d963554c7 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:24.814451 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e0d590e3-22a5-4379-8dea-e17d963554c7 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:24.814919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e0d590e3-22a5-4379-8dea-e17d963554c7 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:24.815439 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e0d590e3-22a5-4379-8dea-e17d963554c7 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:24.816136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e0d590e3-22a5-4379-8dea-e17d963554c7 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:24.816580 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e0d590e3-22a5-4379-8dea-e17d963554c7 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:24.816993 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e0d590e3-22a5-4379-8dea-e17d963554c7 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:24.897701 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e0d590e3-22a5-4379-8dea-e17d963554c7 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:24.906069 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e0d590e3-22a5-4379-8dea-e17d963554c7 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2" status: 200 len: 1297 microversion: 2.1 time: 0.102788 Aug 17 08:42:24.907250 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 235/469] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:24 2022] GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2 => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:25.926928 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-16636b5d-a3ca-4dba-addc-de82c1c47af9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:25.927488 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-16636b5d-a3ca-4dba-addc-de82c1c47af9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:25.933901 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-16636b5d-a3ca-4dba-addc-de82c1c47af9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:25.934383 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-16636b5d-a3ca-4dba-addc-de82c1c47af9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:25.934814 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-16636b5d-a3ca-4dba-addc-de82c1c47af9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:25.935495 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-16636b5d-a3ca-4dba-addc-de82c1c47af9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:25.935978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-16636b5d-a3ca-4dba-addc-de82c1c47af9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:25.936401 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-16636b5d-a3ca-4dba-addc-de82c1c47af9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:26.136505 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-16636b5d-a3ca-4dba-addc-de82c1c47af9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:26.145202 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-16636b5d-a3ca-4dba-addc-de82c1c47af9 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2" status: 200 len: 1362 microversion: 2.1 time: 0.222183 Aug 17 08:42:26.146591 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 235/470] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:25 2022] GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2 => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:26.377454 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-65fece59-d70f-4faf-85fb-134b6f78da33 req-ae644a51-c1f8-413e-9f6a-fb810e8962a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2079306f-d3fe-4fee-87fd-02bc595e53e2", "tag": "c4513763-19f1-4fff-a99c-27f312f66f82"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:42:26.387280 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-65fece59-d70f-4faf-85fb-134b6f78da33 req-ae644a51-c1f8-413e-9f6a-fb810e8962a6 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:26.387803 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-65fece59-d70f-4faf-85fb-134b6f78da33 req-ae644a51-c1f8-413e-9f6a-fb810e8962a6 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:26.388230 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-65fece59-d70f-4faf-85fb-134b6f78da33 req-ae644a51-c1f8-413e-9f6a-fb810e8962a6 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:26.399053 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-65fece59-d70f-4faf-85fb-134b6f78da33 req-ae644a51-c1f8-413e-9f6a-fb810e8962a6 service nova] Creating event network-changed:c4513763-19f1-4fff-a99c-27f312f66f82 for instance 2079306f-d3fe-4fee-87fd-02bc595e53e2 on hv-cinder-85331 Aug 17 08:42:26.412237 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-65fece59-d70f-4faf-85fb-134b6f78da33 req-ae644a51-c1f8-413e-9f6a-fb810e8962a6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039042 Aug 17 08:42:26.412862 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 236/471] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:42:27.167655 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-7d7ec235-1b6f-4a95-ae8f-f2d1e9e33691 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:27.168255 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7d7ec235-1b6f-4a95-ae8f-f2d1e9e33691 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:27.174609 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7d7ec235-1b6f-4a95-ae8f-f2d1e9e33691 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:27.175079 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7d7ec235-1b6f-4a95-ae8f-f2d1e9e33691 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:27.175503 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7d7ec235-1b6f-4a95-ae8f-f2d1e9e33691 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:27.176189 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7d7ec235-1b6f-4a95-ae8f-f2d1e9e33691 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:27.176628 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7d7ec235-1b6f-4a95-ae8f-f2d1e9e33691 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:27.177039 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7d7ec235-1b6f-4a95-ae8f-f2d1e9e33691 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:27.310147 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-7d7ec235-1b6f-4a95-ae8f-f2d1e9e33691 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:27.317747 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-7d7ec235-1b6f-4a95-ae8f-f2d1e9e33691 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2" status: 200 len: 1362 microversion: 2.1 time: 0.153865 Aug 17 08:42:27.318458 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 236/472] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:27 2022] GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:28.339914 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-cd3e6402-0ea0-4026-b15d-916622cdc448 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:28.341114 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-cd3e6402-0ea0-4026-b15d-916622cdc448 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:28.347105 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cd3e6402-0ea0-4026-b15d-916622cdc448 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:28.347614 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cd3e6402-0ea0-4026-b15d-916622cdc448 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:28.348050 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cd3e6402-0ea0-4026-b15d-916622cdc448 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:28.348740 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cd3e6402-0ea0-4026-b15d-916622cdc448 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:28.349193 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cd3e6402-0ea0-4026-b15d-916622cdc448 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:28.349621 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cd3e6402-0ea0-4026-b15d-916622cdc448 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:28.489621 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-cd3e6402-0ea0-4026-b15d-916622cdc448 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:28.497111 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-cd3e6402-0ea0-4026-b15d-916622cdc448 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2" status: 200 len: 1362 microversion: 2.1 time: 0.161936 Aug 17 08:42:28.497668 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 237/473] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:28 2022] GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:29.517160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e083cc6f-b5af-417e-8ad8-ce4993ccd771 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:29.517771 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e083cc6f-b5af-417e-8ad8-ce4993ccd771 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:29.524396 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e083cc6f-b5af-417e-8ad8-ce4993ccd771 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:29.524883 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e083cc6f-b5af-417e-8ad8-ce4993ccd771 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:29.525312 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e083cc6f-b5af-417e-8ad8-ce4993ccd771 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:29.526005 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e083cc6f-b5af-417e-8ad8-ce4993ccd771 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:29.526850 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e083cc6f-b5af-417e-8ad8-ce4993ccd771 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:29.527276 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e083cc6f-b5af-417e-8ad8-ce4993ccd771 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:29.679747 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e083cc6f-b5af-417e-8ad8-ce4993ccd771 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:29.687830 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e083cc6f-b5af-417e-8ad8-ce4993ccd771 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2" status: 200 len: 1362 microversion: 2.1 time: 0.174528 Aug 17 08:42:29.688399 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 237/474] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:29 2022] GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:30.708781 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ea18d0b7-9ffc-4fee-a58b-8369b269f0a7 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:30.709397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ea18d0b7-9ffc-4fee-a58b-8369b269f0a7 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:30.716001 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ea18d0b7-9ffc-4fee-a58b-8369b269f0a7 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:30.716478 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ea18d0b7-9ffc-4fee-a58b-8369b269f0a7 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:30.716900 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ea18d0b7-9ffc-4fee-a58b-8369b269f0a7 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:30.717577 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ea18d0b7-9ffc-4fee-a58b-8369b269f0a7 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:30.718024 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ea18d0b7-9ffc-4fee-a58b-8369b269f0a7 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:30.718438 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ea18d0b7-9ffc-4fee-a58b-8369b269f0a7 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:30.850751 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ea18d0b7-9ffc-4fee-a58b-8369b269f0a7 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:30.859302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ea18d0b7-9ffc-4fee-a58b-8369b269f0a7 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2" status: 200 len: 1362 microversion: 2.1 time: 0.154425 Aug 17 08:42:30.859822 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 238/475] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:30 2022] GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:31.069751 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-8ce1dad1-1fae-4722-9ad9-7114c6e0b57f req-5f91333b-e7c0-4efa-9860-f2c1a8d959c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2079306f-d3fe-4fee-87fd-02bc595e53e2", "name": "network-vif-plugged", "status": "completed", "tag": "c4513763-19f1-4fff-a99c-27f312f66f82"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:42:31.081270 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-8ce1dad1-1fae-4722-9ad9-7114c6e0b57f req-5f91333b-e7c0-4efa-9860-f2c1a8d959c0 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:31.082866 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-8ce1dad1-1fae-4722-9ad9-7114c6e0b57f req-5f91333b-e7c0-4efa-9860-f2c1a8d959c0 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:31.083333 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-8ce1dad1-1fae-4722-9ad9-7114c6e0b57f req-5f91333b-e7c0-4efa-9860-f2c1a8d959c0 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:31.096244 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-8ce1dad1-1fae-4722-9ad9-7114c6e0b57f req-5f91333b-e7c0-4efa-9860-f2c1a8d959c0 service nova] Creating event network-vif-plugged:c4513763-19f1-4fff-a99c-27f312f66f82 for instance 2079306f-d3fe-4fee-87fd-02bc595e53e2 on hv-cinder-85331 Aug 17 08:42:31.102221 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-8ce1dad1-1fae-4722-9ad9-7114c6e0b57f req-5f91333b-e7c0-4efa-9860-f2c1a8d959c0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036385 Aug 17 08:42:31.102884 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 238/476] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:42:31.880443 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-249e98d5-3506-42de-8f64-bd6ab5515fb2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:31.881038 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-249e98d5-3506-42de-8f64-bd6ab5515fb2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:31.887906 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-249e98d5-3506-42de-8f64-bd6ab5515fb2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:31.888379 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-249e98d5-3506-42de-8f64-bd6ab5515fb2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:31.888801 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-249e98d5-3506-42de-8f64-bd6ab5515fb2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:31.889474 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-249e98d5-3506-42de-8f64-bd6ab5515fb2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:31.889918 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-249e98d5-3506-42de-8f64-bd6ab5515fb2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:31.890330 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-249e98d5-3506-42de-8f64-bd6ab5515fb2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:32.029537 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-249e98d5-3506-42de-8f64-bd6ab5515fb2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:32.037182 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-249e98d5-3506-42de-8f64-bd6ab5515fb2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2" status: 200 len: 1362 microversion: 2.1 time: 0.160640 Aug 17 08:42:32.037822 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 239/477] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:31 2022] GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:33.058566 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-fbc3cf38-3a7c-43ce-b3e8-beef2838277e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:33.059322 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-fbc3cf38-3a7c-43ce-b3e8-beef2838277e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:33.066214 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fbc3cf38-3a7c-43ce-b3e8-beef2838277e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:33.066697 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fbc3cf38-3a7c-43ce-b3e8-beef2838277e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:33.067129 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fbc3cf38-3a7c-43ce-b3e8-beef2838277e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:33.067932 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fbc3cf38-3a7c-43ce-b3e8-beef2838277e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:33.068382 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fbc3cf38-3a7c-43ce-b3e8-beef2838277e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:33.068850 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fbc3cf38-3a7c-43ce-b3e8-beef2838277e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:33.285714 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-fbc3cf38-3a7c-43ce-b3e8-beef2838277e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:33.293545 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-fbc3cf38-3a7c-43ce-b3e8-beef2838277e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2" status: 200 len: 1547 microversion: 2.1 time: 0.238993 Aug 17 08:42:33.294052 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 239/478] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:33 2022] GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2 => generated 1547 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:33.314450 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e74e9298-e196-408c-a7b2-c8222d47da86 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:33.314962 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e74e9298-e196-408c-a7b2-c8222d47da86 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:33.321988 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e74e9298-e196-408c-a7b2-c8222d47da86 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:33.322469 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e74e9298-e196-408c-a7b2-c8222d47da86 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:33.322903 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e74e9298-e196-408c-a7b2-c8222d47da86 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:33.323622 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e74e9298-e196-408c-a7b2-c8222d47da86 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:33.324076 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e74e9298-e196-408c-a7b2-c8222d47da86 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:33.325094 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e74e9298-e196-408c-a7b2-c8222d47da86 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:33.403767 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e74e9298-e196-408c-a7b2-c8222d47da86 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093580 Aug 17 08:42:33.404366 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 240/479] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 17 08:42:33 2022] GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:42:34.163119 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-4eebfadf-ad43-4ed3-b9c8-f244f7de0bd7 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1951761595"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:42:34.163656 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-4eebfadf-ad43-4ed3-b9c8-f244f7de0bd7 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:34.166927 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=6 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:42:34.175592 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4eebfadf-ad43-4ed3-b9c8-f244f7de0bd7 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:34.176078 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4eebfadf-ad43-4ed3-b9c8-f244f7de0bd7 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:34.176516 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4eebfadf-ad43-4ed3-b9c8-f244f7de0bd7 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:34.177202 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4eebfadf-ad43-4ed3-b9c8-f244f7de0bd7 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:34.178532 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4eebfadf-ad43-4ed3-b9c8-f244f7de0bd7 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:34.178964 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4eebfadf-ad43-4ed3-b9c8-f244f7de0bd7 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:34.183768 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:42:34.329397 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.network.security_group_api [None req-4eebfadf-ad43-4ed3-b9c8-f244f7de0bd7 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Removing security group 11cbc0ed-1328-46fb-9e40-c4aa41c3ace0 from port 9f364177-8ecc-4da1-86aa-209bcf11e8dc Aug 17 08:42:34.589921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:42:34.591208 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=6 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:42:34.595913 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-37297e8f-752f-4b18-b154-fb7af102e4f3 req-ae43f254-2924-4161-9660-f44fcc9350a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2079306f-d3fe-4fee-87fd-02bc595e53e2", "tag": "c4513763-19f1-4fff-a99c-27f312f66f82"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:42:34.607269 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-37297e8f-752f-4b18-b154-fb7af102e4f3 req-ae43f254-2924-4161-9660-f44fcc9350a6 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:34.607771 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-37297e8f-752f-4b18-b154-fb7af102e4f3 req-ae43f254-2924-4161-9660-f44fcc9350a6 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:34.608194 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-37297e8f-752f-4b18-b154-fb7af102e4f3 req-ae43f254-2924-4161-9660-f44fcc9350a6 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:34.619885 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-37297e8f-752f-4b18-b154-fb7af102e4f3 req-ae43f254-2924-4161-9660-f44fcc9350a6 service nova] Creating event network-changed:c4513763-19f1-4fff-a99c-27f312f66f82 for instance 2079306f-d3fe-4fee-87fd-02bc595e53e2 on hv-cinder-85331 Aug 17 08:42:34.625490 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-37297e8f-752f-4b18-b154-fb7af102e4f3 req-ae43f254-2924-4161-9660-f44fcc9350a6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036167 Aug 17 08:42:34.626482 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 241/480] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:42:34.684782 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-4eebfadf-ad43-4ed3-b9c8-f244f7de0bd7 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "POST /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7/action" status: 202 len: 0 microversion: 2.1 time: 0.527050 Aug 17 08:42:34.685388 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 240/481] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 08:42:34 2022] POST /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:42:34.706078 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-da5f2a92-3294-4152-94ff-8e1912030e22 req-0a44b036-b928-4aaf-a117-7843156c580a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92675ce7-75fe-4b8e-afae-d1940474e4b7", "tag": "9f364177-8ecc-4da1-86aa-209bcf11e8dc"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:42:34.718150 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-da5f2a92-3294-4152-94ff-8e1912030e22 req-0a44b036-b928-4aaf-a117-7843156c580a service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:34.718959 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-da5f2a92-3294-4152-94ff-8e1912030e22 req-0a44b036-b928-4aaf-a117-7843156c580a service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:34.719648 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-da5f2a92-3294-4152-94ff-8e1912030e22 req-0a44b036-b928-4aaf-a117-7843156c580a service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:34.738003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-da5f2a92-3294-4152-94ff-8e1912030e22 req-0a44b036-b928-4aaf-a117-7843156c580a service nova] Creating event network-changed:9f364177-8ecc-4da1-86aa-209bcf11e8dc for instance 92675ce7-75fe-4b8e-afae-d1940474e4b7 on hv-cinder-85331 Aug 17 08:42:34.744715 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-da5f2a92-3294-4152-94ff-8e1912030e22 req-0a44b036-b928-4aaf-a117-7843156c580a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045794 Aug 17 08:42:34.746009 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 242/482] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:42:36.252596 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1bf86d97-c2c8-436f-9f22-f94ac86d1e2b tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:36.253245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1bf86d97-c2c8-436f-9f22-f94ac86d1e2b tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:36.259161 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1bf86d97-c2c8-436f-9f22-f94ac86d1e2b tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:36.259669 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1bf86d97-c2c8-436f-9f22-f94ac86d1e2b tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:36.260099 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1bf86d97-c2c8-436f-9f22-f94ac86d1e2b tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:36.260774 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1bf86d97-c2c8-436f-9f22-f94ac86d1e2b tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:36.261352 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1bf86d97-c2c8-436f-9f22-f94ac86d1e2b tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:36.261818 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1bf86d97-c2c8-436f-9f22-f94ac86d1e2b tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:36.342092 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-1bf86d97-c2c8-436f-9f22-f94ac86d1e2b tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lazy-loading 'services' on Instance uuid 92675ce7-75fe-4b8e-afae-d1940474e4b7 {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:42:36.419367 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1bf86d97-c2c8-436f-9f22-f94ac86d1e2b tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "DELETE /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7/os-volume_attachments/85b7c328-eda0-4fa8-9a23-49da8c5ec58a" status: 202 len: 0 microversion: 2.1 time: 0.171117 Aug 17 08:42:36.420124 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 241/483] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 08:42:36 2022] DELETE /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7/os-volume_attachments/85b7c328-eda0-4fa8-9a23-49da8c5ec58a => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:42:36.429536 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3f25826e-fa6b-40ed-8c4f-5850f1e27c28 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:36.442065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3f25826e-fa6b-40ed-8c4f-5850f1e27c28 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:36.448846 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3f25826e-fa6b-40ed-8c4f-5850f1e27c28 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:36.449987 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3f25826e-fa6b-40ed-8c4f-5850f1e27c28 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:36.451360 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3f25826e-fa6b-40ed-8c4f-5850f1e27c28 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:36.452095 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3f25826e-fa6b-40ed-8c4f-5850f1e27c28 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:36.452549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3f25826e-fa6b-40ed-8c4f-5850f1e27c28 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:36.452971 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3f25826e-fa6b-40ed-8c4f-5850f1e27c28 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:36.489503 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3f25826e-fa6b-40ed-8c4f-5850f1e27c28 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064681 Aug 17 08:42:36.490084 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 243/484] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 08:42:36 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:42:36.641595 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-e99e89af-9d50-4021-aa53-2e4956442356 req-acf546ff-0af0-44ce-bd96-d3e49c308c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92675ce7-75fe-4b8e-afae-d1940474e4b7", "tag": "9f364177-8ecc-4da1-86aa-209bcf11e8dc"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:42:36.651056 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-e99e89af-9d50-4021-aa53-2e4956442356 req-acf546ff-0af0-44ce-bd96-d3e49c308c82 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:36.651524 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-e99e89af-9d50-4021-aa53-2e4956442356 req-acf546ff-0af0-44ce-bd96-d3e49c308c82 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:36.652046 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-e99e89af-9d50-4021-aa53-2e4956442356 req-acf546ff-0af0-44ce-bd96-d3e49c308c82 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:36.662637 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-e99e89af-9d50-4021-aa53-2e4956442356 req-acf546ff-0af0-44ce-bd96-d3e49c308c82 service nova] Creating event network-changed:9f364177-8ecc-4da1-86aa-209bcf11e8dc for instance 92675ce7-75fe-4b8e-afae-d1940474e4b7 on hv-cinder-85331 Aug 17 08:42:36.667402 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-e99e89af-9d50-4021-aa53-2e4956442356 req-acf546ff-0af0-44ce-bd96-d3e49c308c82 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029832 Aug 17 08:42:36.668524 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 242/485] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:42:37.501855 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6769228d-dd89-441d-ac59-6be9442c8360 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:37.504570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6769228d-dd89-441d-ac59-6be9442c8360 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:37.510918 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6769228d-dd89-441d-ac59-6be9442c8360 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:37.511311 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6769228d-dd89-441d-ac59-6be9442c8360 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:37.512477 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6769228d-dd89-441d-ac59-6be9442c8360 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:37.513339 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6769228d-dd89-441d-ac59-6be9442c8360 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:37.513939 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6769228d-dd89-441d-ac59-6be9442c8360 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:37.514508 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6769228d-dd89-441d-ac59-6be9442c8360 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:37.544707 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6769228d-dd89-441d-ac59-6be9442c8360 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046754 Aug 17 08:42:37.545415 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 244/486] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 08:42:37 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 08:42:37.557408 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-455ff776-cb43-4a86-aea9-5b733996f9dc tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:37.558057 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-455ff776-cb43-4a86-aea9-5b733996f9dc tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:37.564301 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-455ff776-cb43-4a86-aea9-5b733996f9dc tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:37.565674 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-455ff776-cb43-4a86-aea9-5b733996f9dc tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:37.565986 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-455ff776-cb43-4a86-aea9-5b733996f9dc tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:37.566878 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-455ff776-cb43-4a86-aea9-5b733996f9dc tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:37.567290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-455ff776-cb43-4a86-aea9-5b733996f9dc tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:37.567820 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-455ff776-cb43-4a86-aea9-5b733996f9dc tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:37.647520 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-455ff776-cb43-4a86-aea9-5b733996f9dc tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] HTTP exception thrown: Instance 92675ce7-75fe-4b8e-afae-d1940474e4b7 is not attached to volume 85b7c328-eda0-4fa8-9a23-49da8c5ec58a Aug 17 08:42:37.649910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-455ff776-cb43-4a86-aea9-5b733996f9dc tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Request method failure captured: Aug 17 08:42:37.649910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: DELETE /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7/os-volume_attachments/85b7c328-eda0-4fa8-9a23-49da8c5ec58a HTTP/1.1 Aug 17 08:42:37.649910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:42:37.649910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:42:37.649910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:42:37.649910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:42:37.649910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:42:37.649910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:42:37.649910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:42:37.649910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:42:37.649910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_Kk-TmhkMYOuqJHZykEwqbXJ41lWdmUilE_oGqwGUgdM4dysgYvvU7lT4V0KRLPIhmKciwTaMnShhu5oxcSWoYiUUKXe_ZZZwosZJxXoKPlGzaCyiAjEJBnRKL5SCFZuIzQa1M3gg9qn7OAy5HYTeJV8g8c52PD0perERc8gdNdkPFM Aug 17 08:42:37.649910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:42:37.649910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:42:37.649910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:42:37.649910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:42:37.649910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:42:37.649910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:42:37.649910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: 8c0e70db84d64777af111825ff71df8c Aug 17 08:42:37.649910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-TestMinimumBasicScenario-111604262 Aug 17 08:42:37.649910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:42:37.649910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:42:37.651477 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8c0e70db84d64777af111825ff71df8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8c0e70db84d64777af111825ff71df8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8c0e70db84d64777af111825ff71df8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8c0e70db84d64777af111825ff71df8c", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:42:37.651477 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-TestMinimumBasicScenario-111604262 Aug 17 08:42:37.651477 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 8c0e70db84d64777af111825ff71df8c Aug 17 08:42:37.651477 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-TestMinimumBasicScenario-111604262 Aug 17 08:42:37.651477 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-TestMinimumBasicScenario-111604262-project Aug 17 08:42:37.651477 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:42:37.651477 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:42:37.651477 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: 954309a32da947518f8ad201dfa51ccb Aug 17 08:42:37.651477 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-TestMinimumBasicScenario-111604262-project Aug 17 08:42:37.651477 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:42:37.651477 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Instance 92675ce7-75fe-4b8e-afae-d1940474e4b7 is not attached to volume 85b7c328-eda0-4fa8-9a23-49da8c5ec58a Aug 17 08:42:37.652933 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'server_id': '92675ce7-75fe-4b8e-afae-d1940474e4b7', 'id': '85b7c328-eda0-4fa8-9a23-49da8c5ec58a'} Aug 17 08:42:37.652933 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:42:37.652933 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:42:37.652933 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 17 08:42:37.652933 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 17 08:42:37.652933 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 08:42:37.652933 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 08:42:37.652933 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 17 08:42:37.652933 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 17 08:42:37.652933 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 85b7c328-eda0-4fa8-9a23-49da8c5ec58a. Aug 17 08:42:37.652933 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:42:37.652933 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:42:37.652933 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:42:37.652933 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:42:37.652933 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:42:37.652933 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:42:37.652933 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:42:37.652933 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:42:37.652933 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:42:37.654408 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:42:37.654408 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 17 08:42:37.654408 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 17 08:42:37.654408 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92675ce7-75fe-4b8e-afae-d1940474e4b7 is not attached to volume 85b7c328-eda0-4fa8-9a23-49da8c5ec58a Aug 17 08:42:37.654408 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:42:37.654408 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:42:37.654408 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:42:37.654408 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:42:37.654408 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:42:37.654408 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:42:37.654408 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:42:37.654408 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:42:37.654408 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92675ce7-75fe-4b8e-afae-d1940474e4b7 is not attached to volume 85b7c328-eda0-4fa8-9a23-49da8c5ec58a Aug 17 08:42:37.654408 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:42:37.654408 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-455ff776-cb43-4a86-aea9-5b733996f9dc tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Returning 404 to user: Instance 92675ce7-75fe-4b8e-afae-d1940474e4b7 is not attached to volume 85b7c328-eda0-4fa8-9a23-49da8c5ec58a {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:42:37.655798 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-455ff776-cb43-4a86-aea9-5b733996f9dc tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "DELETE /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7/os-volume_attachments/85b7c328-eda0-4fa8-9a23-49da8c5ec58a" status: 404 len: 154 microversion: 2.1 time: 0.099422 Aug 17 08:42:37.655798 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 243/487] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 08:42:37 2022] DELETE /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7/os-volume_attachments/85b7c328-eda0-4fa8-9a23-49da8c5ec58a => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:42:38.788167 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-08c0e5bf-9a35-441b-a4e4-9cf0fdbcf494 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:38.788643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-08c0e5bf-9a35-441b-a4e4-9cf0fdbcf494 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:38.795496 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-08c0e5bf-9a35-441b-a4e4-9cf0fdbcf494 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:38.796008 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-08c0e5bf-9a35-441b-a4e4-9cf0fdbcf494 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:38.796437 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-08c0e5bf-9a35-441b-a4e4-9cf0fdbcf494 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:38.797117 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-08c0e5bf-9a35-441b-a4e4-9cf0fdbcf494 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:38.797562 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-08c0e5bf-9a35-441b-a4e4-9cf0fdbcf494 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:38.797980 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-08c0e5bf-9a35-441b-a4e4-9cf0fdbcf494 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:38.801904 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=89 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:42:38.821771 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-08c0e5bf-9a35-441b-a4e4-9cf0fdbcf494 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Going to try to terminate instance {{(pid=127297) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 08:42:38.902080 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-08c0e5bf-9a35-441b-a4e4-9cf0fdbcf494 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "DELETE /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 204 len: 0 microversion: 2.1 time: 0.117392 Aug 17 08:42:38.903500 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 245/488] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:42:38 2022] DELETE /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 08:42:38.911467 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-96ca950c-d815-43a4-9df9-5c90e72cb9ac tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:38.912091 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-96ca950c-d815-43a4-9df9-5c90e72cb9ac tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:38.918110 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-96ca950c-d815-43a4-9df9-5c90e72cb9ac tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:38.918590 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-96ca950c-d815-43a4-9df9-5c90e72cb9ac tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:38.919019 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-96ca950c-d815-43a4-9df9-5c90e72cb9ac tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:38.919726 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-96ca950c-d815-43a4-9df9-5c90e72cb9ac tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:38.920175 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-96ca950c-d815-43a4-9df9-5c90e72cb9ac tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:38.920594 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-96ca950c-d815-43a4-9df9-5c90e72cb9ac tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:39.051827 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-96ca950c-d815-43a4-9df9-5c90e72cb9ac tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:39.059377 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-96ca950c-d815-43a4-9df9-5c90e72cb9ac tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1553 microversion: 2.1 time: 0.151772 Aug 17 08:42:39.059966 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 244/489] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:38 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:40.079922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-91a99b69-caaa-4c95-af17-1b12721749db tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:40.080605 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-91a99b69-caaa-4c95-af17-1b12721749db tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:40.086861 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-91a99b69-caaa-4c95-af17-1b12721749db tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:40.087334 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-91a99b69-caaa-4c95-af17-1b12721749db tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:40.087792 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-91a99b69-caaa-4c95-af17-1b12721749db tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:40.088460 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-91a99b69-caaa-4c95-af17-1b12721749db tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:40.088901 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-91a99b69-caaa-4c95-af17-1b12721749db tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:40.089312 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-91a99b69-caaa-4c95-af17-1b12721749db tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:40.416071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-91a99b69-caaa-4c95-af17-1b12721749db tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:40.423356 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-91a99b69-caaa-4c95-af17-1b12721749db tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1553 microversion: 2.1 time: 0.347931 Aug 17 08:42:40.423946 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 246/490] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:40 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1553 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:41.327550 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-644739b3-72df-4e6e-9dc5-df8f28f5a0a2 req-1434feb0-c722-4f5b-9ea0-83b5fc3e51da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92675ce7-75fe-4b8e-afae-d1940474e4b7", "name": "network-vif-deleted", "tag": "9f364177-8ecc-4da1-86aa-209bcf11e8dc"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:42:41.337716 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-644739b3-72df-4e6e-9dc5-df8f28f5a0a2 req-1434feb0-c722-4f5b-9ea0-83b5fc3e51da service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:41.338181 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-644739b3-72df-4e6e-9dc5-df8f28f5a0a2 req-1434feb0-c722-4f5b-9ea0-83b5fc3e51da service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:41.338601 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-644739b3-72df-4e6e-9dc5-df8f28f5a0a2 req-1434feb0-c722-4f5b-9ea0-83b5fc3e51da service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:41.349813 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-644739b3-72df-4e6e-9dc5-df8f28f5a0a2 req-1434feb0-c722-4f5b-9ea0-83b5fc3e51da service nova] Creating event network-vif-deleted:9f364177-8ecc-4da1-86aa-209bcf11e8dc for instance 92675ce7-75fe-4b8e-afae-d1940474e4b7 on hv-cinder-85331 Aug 17 08:42:41.354643 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-644739b3-72df-4e6e-9dc5-df8f28f5a0a2 req-1434feb0-c722-4f5b-9ea0-83b5fc3e51da service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030704 Aug 17 08:42:41.356060 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 245/491] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:42:41.444199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-42879732-7398-455e-8ddd-39aaa33b7437 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:41.444805 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-42879732-7398-455e-8ddd-39aaa33b7437 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:41.451201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-42879732-7398-455e-8ddd-39aaa33b7437 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:41.451745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-42879732-7398-455e-8ddd-39aaa33b7437 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:41.452182 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-42879732-7398-455e-8ddd-39aaa33b7437 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:41.452892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-42879732-7398-455e-8ddd-39aaa33b7437 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:41.453828 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-42879732-7398-455e-8ddd-39aaa33b7437 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:41.454260 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-42879732-7398-455e-8ddd-39aaa33b7437 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:41.489308 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-42879732-7398-455e-8ddd-39aaa33b7437 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:41.490362 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-42879732-7398-455e-8ddd-39aaa33b7437 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:41.490800 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-42879732-7398-455e-8ddd-39aaa33b7437 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:41.491239 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.objects.instance [None req-42879732-7398-455e-8ddd-39aaa33b7437 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lazy-loading 'fault' on Instance uuid 92675ce7-75fe-4b8e-afae-d1940474e4b7 {{(pid=127297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:42:41.536363 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-42879732-7398-455e-8ddd-39aaa33b7437 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954309a32da947518f8ad201dfa51ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0e70db84d64777af111825ff71df8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:41.544460 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-42879732-7398-455e-8ddd-39aaa33b7437 tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 200 len: 1349 microversion: 2.1 time: 0.104130 Aug 17 08:42:41.545021 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 247/492] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:41 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 1349 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:42.565384 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-663fba0f-db68-4f7a-8cde-c000732c1e9a tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:42.566068 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-663fba0f-db68-4f7a-8cde-c000732c1e9a tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] [instance: 92675ce7-75fe-4b8e-afae-d1940474e4b7] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:42.572161 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-663fba0f-db68-4f7a-8cde-c000732c1e9a tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:42.572630 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-663fba0f-db68-4f7a-8cde-c000732c1e9a tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:42.573054 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-663fba0f-db68-4f7a-8cde-c000732c1e9a tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:42.573723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-663fba0f-db68-4f7a-8cde-c000732c1e9a tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:42.574162 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-663fba0f-db68-4f7a-8cde-c000732c1e9a tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:42.574574 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-663fba0f-db68-4f7a-8cde-c000732c1e9a tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:42.587503 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-663fba0f-db68-4f7a-8cde-c000732c1e9a tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] HTTP exception thrown: Instance 92675ce7-75fe-4b8e-afae-d1940474e4b7 could not be found. Aug 17 08:42:42.589075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-663fba0f-db68-4f7a-8cde-c000732c1e9a tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Request method failure captured: Aug 17 08:42:42.589075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 HTTP/1.1 Aug 17 08:42:42.589075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:42:42.589075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:42:42.589075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:42:42.589075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:42:42.589075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:42:42.589075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:42:42.589075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:42:42.589075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:42:42.589075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_Kk-TmhkMYOuqJHZykEwqbXJ41lWdmUilE_oGqwGUgdM4dysgYvvU7lT4V0KRLPIhmKciwTaMnShhu5oxcSWoYiUUKXe_ZZZwosZJxXoKPlGzaCyiAjEJBnRKL5SCFZuIzQa1M3gg9qn7OAy5HYTeJV8g8c52PD0perERc8gdNdkPFM Aug 17 08:42:42.589075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:42:42.589075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:42:42.589075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:42:42.589075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:42:42.589075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:42:42.589075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:42:42.589075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: 8c0e70db84d64777af111825ff71df8c Aug 17 08:42:42.589075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-TestMinimumBasicScenario-111604262 Aug 17 08:42:42.589075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:42:42.589075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:42:42.591007 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8c0e70db84d64777af111825ff71df8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8c0e70db84d64777af111825ff71df8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8c0e70db84d64777af111825ff71df8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8c0e70db84d64777af111825ff71df8c", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:42:42.591007 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-TestMinimumBasicScenario-111604262 Aug 17 08:42:42.591007 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 8c0e70db84d64777af111825ff71df8c Aug 17 08:42:42.591007 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-TestMinimumBasicScenario-111604262 Aug 17 08:42:42.591007 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-TestMinimumBasicScenario-111604262-project Aug 17 08:42:42.591007 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:42:42.591007 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:42:42.591007 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: 954309a32da947518f8ad201dfa51ccb Aug 17 08:42:42.591007 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-TestMinimumBasicScenario-111604262-project Aug 17 08:42:42.591007 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:42:42.591007 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Instance 92675ce7-75fe-4b8e-afae-d1940474e4b7 could not be found. Aug 17 08:42:42.591007 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'id': '92675ce7-75fe-4b8e-afae-d1940474e4b7'} Aug 17 08:42:42.591882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:42:42.591882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:42:42.591882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:42:42.591882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:42:42.591882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:42:42.591882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:42:42.591882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:42:42.591882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:42:42.591882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:42:42.591882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:42:42.591882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92675ce7-75fe-4b8e-afae-d1940474e4b7 could not be found. Aug 17 08:42:42.591882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:42:42.591882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:42:42.591882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:42:42.591882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:42:42.591882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:42:42.591882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:42:42.591882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:42:42.591882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:42:42.591882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:42:42.593361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:42:42.593361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:42:42.593361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:42:42.593361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:42:42.593361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:42:42.593361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:42:42.593361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:42:42.593361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92675ce7-75fe-4b8e-afae-d1940474e4b7 could not be found. Aug 17 08:42:42.593361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:42:42.593361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:42:42.593361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:42:42.593361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:42:42.593361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:42:42.593361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:42:42.593361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:42:42.593361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:42:42.593361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92675ce7-75fe-4b8e-afae-d1940474e4b7 could not be found. Aug 17 08:42:42.593361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:42:42.594674 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-663fba0f-db68-4f7a-8cde-c000732c1e9a tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Returning 404 to user: Instance 92675ce7-75fe-4b8e-afae-d1940474e4b7 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:42:42.594674 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-663fba0f-db68-4f7a-8cde-c000732c1e9a tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7" status: 404 len: 111 microversion: 2.1 time: 0.030191 Aug 17 08:42:42.594674 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 246/493] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:42 2022] GET /compute/v2.1/servers/92675ce7-75fe-4b8e-afae-d1940474e4b7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:42:42.599621 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0d5b870d-aa17-45c4-9b65-8980b0c2221e tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] Calling method '.version_select at 0x7f3f85488700>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:42.618371 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0d5b870d-aa17-45c4-9b65-8980b0c2221e tempest-TestMinimumBasicScenario-111604262 tempest-TestMinimumBasicScenario-111604262-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1867202716" status: 202 len: 0 microversion: 2.1 time: 0.022492 Aug 17 08:42:42.618936 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 248/494] 10.222.0.15 () {58 vars in 1272 bytes} [Wed Aug 17 08:42:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1867202716 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:42:45.412493 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6ec89ab7-5770-4822-a634-0618d211e7f5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:45.413044 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6ec89ab7-5770-4822-a634-0618d211e7f5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:45.415816 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:42:45.421958 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6ec89ab7-5770-4822-a634-0618d211e7f5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:45.422476 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6ec89ab7-5770-4822-a634-0618d211e7f5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:45.422898 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6ec89ab7-5770-4822-a634-0618d211e7f5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:45.423613 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6ec89ab7-5770-4822-a634-0618d211e7f5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:45.424225 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6ec89ab7-5770-4822-a634-0618d211e7f5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:45.424835 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6ec89ab7-5770-4822-a634-0618d211e7f5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:45.637700 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-6ec89ab7-5770-4822-a634-0618d211e7f5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lazy-loading 'services' on Instance uuid 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:42:45.721219 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6ec89ab7-5770-4822-a634-0618d211e7f5 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1/os-volume_attachments/4ad52f12-454a-4ba3-9218-8a16d667350b" status: 202 len: 0 microversion: 2.1 time: 0.312828 Aug 17 08:42:45.721913 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 247/495] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 08:42:45 2022] DELETE /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1/os-volume_attachments/4ad52f12-454a-4ba3-9218-8a16d667350b => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:42:45.730946 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-72013dc5-c6cb-4d00-8271-06548813d81e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:45.733032 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-72013dc5-c6cb-4d00-8271-06548813d81e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:45.741075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-72013dc5-c6cb-4d00-8271-06548813d81e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:45.741572 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-72013dc5-c6cb-4d00-8271-06548813d81e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:45.741990 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-72013dc5-c6cb-4d00-8271-06548813d81e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:45.742817 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-72013dc5-c6cb-4d00-8271-06548813d81e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:45.743340 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-72013dc5-c6cb-4d00-8271-06548813d81e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:45.743766 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-72013dc5-c6cb-4d00-8271-06548813d81e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:45.776040 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-72013dc5-c6cb-4d00-8271-06548813d81e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049528 Aug 17 08:42:45.780845 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 249/496] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 08:42:45 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:42:46.789639 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5930ee8b-d428-4212-b6df-7a47afaf4ee9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:46.791995 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5930ee8b-d428-4212-b6df-7a47afaf4ee9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:46.798298 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5930ee8b-d428-4212-b6df-7a47afaf4ee9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:46.798734 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5930ee8b-d428-4212-b6df-7a47afaf4ee9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:46.799263 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5930ee8b-d428-4212-b6df-7a47afaf4ee9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:46.800099 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5930ee8b-d428-4212-b6df-7a47afaf4ee9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:46.800547 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5930ee8b-d428-4212-b6df-7a47afaf4ee9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:46.800963 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5930ee8b-d428-4212-b6df-7a47afaf4ee9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:46.830376 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5930ee8b-d428-4212-b6df-7a47afaf4ee9 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045768 Aug 17 08:42:46.830995 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 248/497] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 08:42:46 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 08:42:46.904268 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-bc587bd6-429b-44f1-b6b6-50315f3cb734 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:46.904863 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-bc587bd6-429b-44f1-b6b6-50315f3cb734 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:46.911923 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bc587bd6-429b-44f1-b6b6-50315f3cb734 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:46.912300 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bc587bd6-429b-44f1-b6b6-50315f3cb734 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:46.912728 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bc587bd6-429b-44f1-b6b6-50315f3cb734 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:46.913422 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bc587bd6-429b-44f1-b6b6-50315f3cb734 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:46.913867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bc587bd6-429b-44f1-b6b6-50315f3cb734 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:46.914283 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bc587bd6-429b-44f1-b6b6-50315f3cb734 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:46.942823 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-bc587bd6-429b-44f1-b6b6-50315f3cb734 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Going to try to terminate instance {{(pid=127297) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 08:42:47.022761 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-bc587bd6-429b-44f1-b6b6-50315f3cb734 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 204 len: 0 microversion: 2.1 time: 0.121919 Aug 17 08:42:47.023354 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 250/498] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:42:46 2022] DELETE /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 08:42:47.031671 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ddcf90c3-0487-4e96-8976-c1091ae6e0d0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:47.032290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ddcf90c3-0487-4e96-8976-c1091ae6e0d0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:47.038309 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ddcf90c3-0487-4e96-8976-c1091ae6e0d0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:47.039061 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ddcf90c3-0487-4e96-8976-c1091ae6e0d0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:47.039488 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ddcf90c3-0487-4e96-8976-c1091ae6e0d0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:47.040213 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ddcf90c3-0487-4e96-8976-c1091ae6e0d0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:47.040653 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ddcf90c3-0487-4e96-8976-c1091ae6e0d0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:47.041064 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ddcf90c3-0487-4e96-8976-c1091ae6e0d0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:47.300604 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ddcf90c3-0487-4e96-8976-c1091ae6e0d0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:47.309040 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ddcf90c3-0487-4e96-8976-c1091ae6e0d0 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1690 microversion: 2.1 time: 0.280657 Aug 17 08:42:47.309707 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 249/499] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:47 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1690 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:48.330681 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-9f5f5a7e-6dd0-41fa-bcde-3031786e8ad1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:48.331642 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-9f5f5a7e-6dd0-41fa-bcde-3031786e8ad1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:48.334066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:42:48.339908 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9f5f5a7e-6dd0-41fa-bcde-3031786e8ad1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:48.340545 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9f5f5a7e-6dd0-41fa-bcde-3031786e8ad1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:48.341160 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9f5f5a7e-6dd0-41fa-bcde-3031786e8ad1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:48.341913 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9f5f5a7e-6dd0-41fa-bcde-3031786e8ad1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:48.342460 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9f5f5a7e-6dd0-41fa-bcde-3031786e8ad1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:48.342940 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9f5f5a7e-6dd0-41fa-bcde-3031786e8ad1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:48.524988 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-9f5f5a7e-6dd0-41fa-bcde-3031786e8ad1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:48.532957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-9f5f5a7e-6dd0-41fa-bcde-3031786e8ad1 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1690 microversion: 2.1 time: 0.206747 Aug 17 08:42:48.534224 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 251/500] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:48 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1690 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:49.564644 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-51e4c55d-ffae-4e6b-a291-7949c807c383 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:49.565245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-51e4c55d-ffae-4e6b-a291-7949c807c383 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:49.571483 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-51e4c55d-ffae-4e6b-a291-7949c807c383 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:49.572228 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-51e4c55d-ffae-4e6b-a291-7949c807c383 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:49.572656 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-51e4c55d-ffae-4e6b-a291-7949c807c383 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:49.573338 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-51e4c55d-ffae-4e6b-a291-7949c807c383 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:49.573984 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-51e4c55d-ffae-4e6b-a291-7949c807c383 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:49.574475 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-51e4c55d-ffae-4e6b-a291-7949c807c383 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:49.707893 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-51e4c55d-ffae-4e6b-a291-7949c807c383 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:49.716222 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-51e4c55d-ffae-4e6b-a291-7949c807c383 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1690 microversion: 2.1 time: 0.161054 Aug 17 08:42:49.716905 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 250/501] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:49 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:50.738184 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8794d6aa-7fed-4e94-9714-bb30347bea27 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:50.738795 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8794d6aa-7fed-4e94-9714-bb30347bea27 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:50.745964 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8794d6aa-7fed-4e94-9714-bb30347bea27 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:50.746453 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8794d6aa-7fed-4e94-9714-bb30347bea27 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:50.746893 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8794d6aa-7fed-4e94-9714-bb30347bea27 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:50.747708 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8794d6aa-7fed-4e94-9714-bb30347bea27 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:50.748169 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8794d6aa-7fed-4e94-9714-bb30347bea27 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:50.748594 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8794d6aa-7fed-4e94-9714-bb30347bea27 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:50.976004 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8794d6aa-7fed-4e94-9714-bb30347bea27 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:50.983633 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8794d6aa-7fed-4e94-9714-bb30347bea27 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1690 microversion: 2.1 time: 0.249468 Aug 17 08:42:50.984201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 252/502] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:50 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1690 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:51.613513 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-a67a3bad-548f-474c-8e60-125b68490a79 req-169298be-7717-4d4e-9106-bfe30a9efacc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1", "name": "network-vif-deleted", "tag": "07a04b7d-775b-4a78-95c5-7fe56d001b03"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:42:51.626827 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-a67a3bad-548f-474c-8e60-125b68490a79 req-169298be-7717-4d4e-9106-bfe30a9efacc service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:51.627324 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-a67a3bad-548f-474c-8e60-125b68490a79 req-169298be-7717-4d4e-9106-bfe30a9efacc service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:51.628122 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-a67a3bad-548f-474c-8e60-125b68490a79 req-169298be-7717-4d4e-9106-bfe30a9efacc service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:51.640375 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-a67a3bad-548f-474c-8e60-125b68490a79 req-169298be-7717-4d4e-9106-bfe30a9efacc service nova] Creating event network-vif-deleted:07a04b7d-775b-4a78-95c5-7fe56d001b03 for instance 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 on hv-cinder-85331 Aug 17 08:42:51.645680 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-a67a3bad-548f-474c-8e60-125b68490a79 req-169298be-7717-4d4e-9106-bfe30a9efacc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036818 Aug 17 08:42:51.646276 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 251/503] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:42:52.004485 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0712d75c-6b55-4589-86f6-770375070413 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:52.005087 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0712d75c-6b55-4589-86f6-770375070413 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:52.011614 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0712d75c-6b55-4589-86f6-770375070413 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:52.012102 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0712d75c-6b55-4589-86f6-770375070413 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:52.012590 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0712d75c-6b55-4589-86f6-770375070413 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:52.013280 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0712d75c-6b55-4589-86f6-770375070413 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:52.013729 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0712d75c-6b55-4589-86f6-770375070413 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:52.014146 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0712d75c-6b55-4589-86f6-770375070413 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:52.048330 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0712d75c-6b55-4589-86f6-770375070413 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:52.048804 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0712d75c-6b55-4589-86f6-770375070413 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:52.049226 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0712d75c-6b55-4589-86f6-770375070413 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:52.049679 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.objects.instance [None req-0712d75c-6b55-4589-86f6-770375070413 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lazy-loading 'fault' on Instance uuid 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 {{(pid=127297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:42:52.097274 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0712d75c-6b55-4589-86f6-770375070413 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:52.105299 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0712d75c-6b55-4589-86f6-770375070413 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 200 len: 1335 microversion: 2.1 time: 0.104047 Aug 17 08:42:52.106054 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 253/504] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:51 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 1335 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:53.126270 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2b2005e3-b7cf-43c4-8901-e73b5d7fc0d6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:53.126954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2b2005e3-b7cf-43c4-8901-e73b5d7fc0d6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:53.133017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2b2005e3-b7cf-43c4-8901-e73b5d7fc0d6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:53.133489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2b2005e3-b7cf-43c4-8901-e73b5d7fc0d6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:53.133917 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2b2005e3-b7cf-43c4-8901-e73b5d7fc0d6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:53.134879 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2b2005e3-b7cf-43c4-8901-e73b5d7fc0d6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:53.135333 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2b2005e3-b7cf-43c4-8901-e73b5d7fc0d6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:53.136300 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2b2005e3-b7cf-43c4-8901-e73b5d7fc0d6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:53.149372 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-2b2005e3-b7cf-43c4-8901-e73b5d7fc0d6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] HTTP exception thrown: Instance 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 could not be found. Aug 17 08:42:53.150978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2b2005e3-b7cf-43c4-8901-e73b5d7fc0d6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Request method failure captured: Aug 17 08:42:53.150978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 HTTP/1.1 Aug 17 08:42:53.150978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:42:53.150978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:42:53.150978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:42:53.150978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:42:53.150978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:42:53.150978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:42:53.150978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:42:53.150978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:42:53.150978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_Kji6Z6va2Uun3O7PfuwZB78DrFVBWntRNdu90xpb_V8I8QwVJ2kvC1hN3MJ79pVctymf4qsZ66__L6U-Av0K3yOggyHXxU1_rw06E-jph23OY_HLUrhK8ayFUMvsxgiYt2c7Y4q-1Au0PC8GFHJjVF0sKN8b-BkvnKkF76FNyXvPfQ Aug 17 08:42:53.150978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:42:53.150978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:42:53.150978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:42:53.150978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:42:53.150978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:42:53.150978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:42:53.150978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: 2f3596b4a1404d3db340943fbd63567d Aug 17 08:42:53.150978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-197889665 Aug 17 08:42:53.150978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:42:53.150978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:42:53.153010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2f3596b4a1404d3db340943fbd63567d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2f3596b4a1404d3db340943fbd63567d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2f3596b4a1404d3db340943fbd63567d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2f3596b4a1404d3db340943fbd63567d", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:42:53.153010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-ServerRescueNegativeTestJSON-197889665 Aug 17 08:42:53.153010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 2f3596b4a1404d3db340943fbd63567d Aug 17 08:42:53.153010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-197889665 Aug 17 08:42:53.153010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-ServerRescueNegativeTestJSON-197889665-project Aug 17 08:42:53.153010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:42:53.153010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:42:53.153010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: f051f99404fc4e0593553ae95e1f90d5 Aug 17 08:42:53.153010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-ServerRescueNegativeTestJSON-197889665-project Aug 17 08:42:53.153010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:42:53.153010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Instance 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 could not be found. Aug 17 08:42:53.153010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'id': '9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1'} Aug 17 08:42:53.153762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:42:53.153762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:42:53.153762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:42:53.153762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:42:53.153762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:42:53.153762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:42:53.153762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:42:53.153762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:42:53.153762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:42:53.153762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:42:53.153762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 could not be found. Aug 17 08:42:53.153762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:42:53.153762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:42:53.153762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:42:53.153762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:42:53.153762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:42:53.153762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:42:53.153762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:42:53.153762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:42:53.153762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:42:53.155304 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:42:53.155304 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:42:53.155304 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:42:53.155304 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:42:53.155304 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:42:53.155304 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:42:53.155304 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:42:53.155304 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 could not be found. Aug 17 08:42:53.155304 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:42:53.155304 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:42:53.155304 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:42:53.155304 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:42:53.155304 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:42:53.155304 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:42:53.155304 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:42:53.155304 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:42:53.155304 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 could not be found. Aug 17 08:42:53.155304 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:42:53.156631 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2b2005e3-b7cf-43c4-8901-e73b5d7fc0d6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Returning 404 to user: Instance 9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:42:53.156631 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2b2005e3-b7cf-43c4-8901-e73b5d7fc0d6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1" status: 404 len: 111 microversion: 2.1 time: 0.031304 Aug 17 08:42:53.156631 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 252/505] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:53 2022] GET /compute/v2.1/servers/9793a3fb-bd95-4f8a-b06e-7eda9d16c6b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:42:53.161764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-df831938-2a34-4985-8420-c2f1669118ee tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '.version_select at 0x7f3f85488550>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:53.179354 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-df831938-2a34-4985-8420-c2f1669118ee tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1292866368" status: 202 len: 0 microversion: 2.1 time: 0.021528 Aug 17 08:42:53.179948 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 254/506] 10.222.0.15 () {58 vars in 1221 bytes} [Wed Aug 17 08:42:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1292866368 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:42:56.212352 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-02136c1f-1f5c-445e-b930-3d8d67381dec tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:56.212883 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-02136c1f-1f5c-445e-b930-3d8d67381dec tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:56.219485 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02136c1f-1f5c-445e-b930-3d8d67381dec tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:56.220145 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02136c1f-1f5c-445e-b930-3d8d67381dec tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:56.220613 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02136c1f-1f5c-445e-b930-3d8d67381dec tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:56.221287 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02136c1f-1f5c-445e-b930-3d8d67381dec tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:56.221730 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02136c1f-1f5c-445e-b930-3d8d67381dec tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:56.222144 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02136c1f-1f5c-445e-b930-3d8d67381dec tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:56.247728 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-02136c1f-1f5c-445e-b930-3d8d67381dec tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 08:42:56.322268 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-02136c1f-1f5c-445e-b930-3d8d67381dec tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "DELETE /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 204 len: 0 microversion: 2.1 time: 0.115279 Aug 17 08:42:56.322959 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 253/507] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:42:56 2022] DELETE /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 08:42:56.332387 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-37276b77-b664-4f22-a845-c58fc116bdef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:56.332992 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-37276b77-b664-4f22-a845-c58fc116bdef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:56.341537 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-37276b77-b664-4f22-a845-c58fc116bdef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:56.342019 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-37276b77-b664-4f22-a845-c58fc116bdef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:56.342446 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-37276b77-b664-4f22-a845-c58fc116bdef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:56.343131 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-37276b77-b664-4f22-a845-c58fc116bdef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:56.343595 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-37276b77-b664-4f22-a845-c58fc116bdef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:56.344013 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-37276b77-b664-4f22-a845-c58fc116bdef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:56.497893 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-37276b77-b664-4f22-a845-c58fc116bdef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:56.505100 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-37276b77-b664-4f22-a845-c58fc116bdef tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1506 microversion: 2.1 time: 0.177593 Aug 17 08:42:56.505650 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 255/508] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:56 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:57.197554 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0781d224-c768-4da4-808a-53867fb82555 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:42:57.198137 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0781d224-c768-4da4-808a-53867fb82555 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:57.204055 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0781d224-c768-4da4-808a-53867fb82555 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:57.204795 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0781d224-c768-4da4-808a-53867fb82555 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:57.205219 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0781d224-c768-4da4-808a-53867fb82555 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:57.205890 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0781d224-c768-4da4-808a-53867fb82555 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:57.206335 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0781d224-c768-4da4-808a-53867fb82555 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:57.206922 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0781d224-c768-4da4-808a-53867fb82555 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:57.229754 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-0781d224-c768-4da4-808a-53867fb82555 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lazy-loading 'flavor' on Instance uuid fe1b2a32-cde6-43da-885e-78a42a55a7f1 {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:42:57.297949 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0781d224-c768-4da4-808a-53867fb82555 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "POST /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1/action" status: 202 len: 0 microversion: 2.1 time: 0.104528 Aug 17 08:42:57.298513 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 254/509] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 08:42:57 2022] POST /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:42:57.306694 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-23c2fc12-3e3c-4664-a2d0-9ddcbd35090f tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:57.307276 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-23c2fc12-3e3c-4664-a2d0-9ddcbd35090f tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:57.313312 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-23c2fc12-3e3c-4664-a2d0-9ddcbd35090f tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:57.313783 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-23c2fc12-3e3c-4664-a2d0-9ddcbd35090f tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:57.314210 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-23c2fc12-3e3c-4664-a2d0-9ddcbd35090f tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:57.314881 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-23c2fc12-3e3c-4664-a2d0-9ddcbd35090f tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:57.315328 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-23c2fc12-3e3c-4664-a2d0-9ddcbd35090f tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:57.315795 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-23c2fc12-3e3c-4664-a2d0-9ddcbd35090f tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:57.445024 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-23c2fc12-3e3c-4664-a2d0-9ddcbd35090f tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:57.452562 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-23c2fc12-3e3c-4664-a2d0-9ddcbd35090f tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1569 microversion: 2.1 time: 0.149711 Aug 17 08:42:57.453065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 256/510] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:57 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:57.527233 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-cb95bfab-25c7-4286-8c41-b570a6d39727 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:57.527977 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-cb95bfab-25c7-4286-8c41-b570a6d39727 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:57.534096 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cb95bfab-25c7-4286-8c41-b570a6d39727 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:57.534573 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cb95bfab-25c7-4286-8c41-b570a6d39727 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:57.534999 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cb95bfab-25c7-4286-8c41-b570a6d39727 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:57.535704 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cb95bfab-25c7-4286-8c41-b570a6d39727 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:57.536150 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cb95bfab-25c7-4286-8c41-b570a6d39727 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:57.536567 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cb95bfab-25c7-4286-8c41-b570a6d39727 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:57.554889 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:42:57.670337 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-cb95bfab-25c7-4286-8c41-b570a6d39727 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:57.677698 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-cb95bfab-25c7-4286-8c41-b570a6d39727 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1506 microversion: 2.1 time: 0.155100 Aug 17 08:42:57.678259 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 255/511] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:57 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:58.473609 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e37f35f5-626c-47ff-8ad1-150354fca927 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:58.474204 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e37f35f5-626c-47ff-8ad1-150354fca927 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:58.480604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e37f35f5-626c-47ff-8ad1-150354fca927 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:58.481076 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e37f35f5-626c-47ff-8ad1-150354fca927 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:58.481500 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e37f35f5-626c-47ff-8ad1-150354fca927 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:58.482172 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e37f35f5-626c-47ff-8ad1-150354fca927 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:58.482618 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e37f35f5-626c-47ff-8ad1-150354fca927 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:58.483028 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e37f35f5-626c-47ff-8ad1-150354fca927 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:58.613810 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e37f35f5-626c-47ff-8ad1-150354fca927 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:58.621215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e37f35f5-626c-47ff-8ad1-150354fca927 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1569 microversion: 2.1 time: 0.151469 Aug 17 08:42:58.621782 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 257/512] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:58 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:58.697698 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-99fbdc8f-d755-45b6-9f5a-0463198a112b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:58.698246 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-99fbdc8f-d755-45b6-9f5a-0463198a112b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:58.705372 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-99fbdc8f-d755-45b6-9f5a-0463198a112b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:58.705847 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-99fbdc8f-d755-45b6-9f5a-0463198a112b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:58.706269 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-99fbdc8f-d755-45b6-9f5a-0463198a112b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:58.706969 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-99fbdc8f-d755-45b6-9f5a-0463198a112b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:58.707409 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-99fbdc8f-d755-45b6-9f5a-0463198a112b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:58.707846 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-99fbdc8f-d755-45b6-9f5a-0463198a112b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:58.839012 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-99fbdc8f-d755-45b6-9f5a-0463198a112b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:58.846898 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-99fbdc8f-d755-45b6-9f5a-0463198a112b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 200 len: 1506 microversion: 2.1 time: 0.153300 Aug 17 08:42:58.847477 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 256/513] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:58 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:59.281444 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-19127084-e16c-4aaf-890f-61c3bceb8e50 req-1e5b237c-c69d-47ed-bfb3-ada2dfa4fc05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eefed036-89ed-46ed-8d8d-ab6b8a9abfce", "name": "network-vif-deleted", "tag": "88ccd260-6726-4fd3-b8cd-7a065527f5cb"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:42:59.292827 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-19127084-e16c-4aaf-890f-61c3bceb8e50 req-1e5b237c-c69d-47ed-bfb3-ada2dfa4fc05 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:59.293296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-19127084-e16c-4aaf-890f-61c3bceb8e50 req-1e5b237c-c69d-47ed-bfb3-ada2dfa4fc05 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:59.293711 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-19127084-e16c-4aaf-890f-61c3bceb8e50 req-1e5b237c-c69d-47ed-bfb3-ada2dfa4fc05 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:59.305270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-19127084-e16c-4aaf-890f-61c3bceb8e50 req-1e5b237c-c69d-47ed-bfb3-ada2dfa4fc05 service nova] Creating event network-vif-deleted:88ccd260-6726-4fd3-b8cd-7a065527f5cb for instance eefed036-89ed-46ed-8d8d-ab6b8a9abfce on hv-cinder-85331 Aug 17 08:42:59.311280 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-19127084-e16c-4aaf-890f-61c3bceb8e50 req-1e5b237c-c69d-47ed-bfb3-ada2dfa4fc05 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033385 Aug 17 08:42:59.312228 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 258/514] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:42:59.642216 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1d20ac07-ff03-4616-865c-c3395258b069 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:59.642820 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1d20ac07-ff03-4616-865c-c3395258b069 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:59.649217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1d20ac07-ff03-4616-865c-c3395258b069 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:59.649695 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1d20ac07-ff03-4616-865c-c3395258b069 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:59.650122 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1d20ac07-ff03-4616-865c-c3395258b069 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:59.650809 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1d20ac07-ff03-4616-865c-c3395258b069 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:59.651256 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1d20ac07-ff03-4616-865c-c3395258b069 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:59.652215 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1d20ac07-ff03-4616-865c-c3395258b069 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:59.786646 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1d20ac07-ff03-4616-865c-c3395258b069 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:42:59.795001 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1d20ac07-ff03-4616-865c-c3395258b069 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1569 microversion: 2.1 time: 0.156672 Aug 17 08:42:59.795775 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 257/515] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:59 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:42:59.869803 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b6d95796-6dc7-4657-a320-56a7be582e4e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:59.870725 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b6d95796-6dc7-4657-a320-56a7be582e4e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: eefed036-89ed-46ed-8d8d-ab6b8a9abfce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:59.877011 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b6d95796-6dc7-4657-a320-56a7be582e4e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:59.877629 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b6d95796-6dc7-4657-a320-56a7be582e4e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:59.878137 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b6d95796-6dc7-4657-a320-56a7be582e4e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:59.878969 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b6d95796-6dc7-4657-a320-56a7be582e4e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:59.879674 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b6d95796-6dc7-4657-a320-56a7be582e4e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:59.880125 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b6d95796-6dc7-4657-a320-56a7be582e4e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:59.894876 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-b6d95796-6dc7-4657-a320-56a7be582e4e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] HTTP exception thrown: Instance eefed036-89ed-46ed-8d8d-ab6b8a9abfce could not be found. Aug 17 08:42:59.896604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b6d95796-6dc7-4657-a320-56a7be582e4e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Request method failure captured: Aug 17 08:42:59.896604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce HTTP/1.1 Aug 17 08:42:59.896604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:42:59.896604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:42:59.896604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:42:59.896604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:42:59.896604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:42:59.896604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:42:59.896604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:42:59.896604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:42:59.896604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_Kji6Z6va2Uun3O7PfuwZB78DrFVBWntRNdu90xpb_V8I8QwVJ2kvC1hN3MJ79pVctymf4qsZ66__L6U-Av0K3yOggyHXxU1_rw06E-jph23OY_HLUrhK8ayFUMvsxgiYt2c7Y4q-1Au0PC8GFHJjVF0sKN8b-BkvnKkF76FNyXvPfQ Aug 17 08:42:59.896604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:42:59.896604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:42:59.896604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:42:59.896604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:42:59.896604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:42:59.896604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:42:59.896604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: 2f3596b4a1404d3db340943fbd63567d Aug 17 08:42:59.896604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-197889665 Aug 17 08:42:59.896604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:42:59.896604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:42:59.898370 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2f3596b4a1404d3db340943fbd63567d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2f3596b4a1404d3db340943fbd63567d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2f3596b4a1404d3db340943fbd63567d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2f3596b4a1404d3db340943fbd63567d", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:42:59.898370 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-ServerRescueNegativeTestJSON-197889665 Aug 17 08:42:59.898370 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 2f3596b4a1404d3db340943fbd63567d Aug 17 08:42:59.898370 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-197889665 Aug 17 08:42:59.898370 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-ServerRescueNegativeTestJSON-197889665-project Aug 17 08:42:59.898370 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:42:59.898370 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:42:59.898370 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: f051f99404fc4e0593553ae95e1f90d5 Aug 17 08:42:59.898370 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-ServerRescueNegativeTestJSON-197889665-project Aug 17 08:42:59.898370 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: > Aug 17 08:42:59.898370 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Instance eefed036-89ed-46ed-8d8d-ab6b8a9abfce could not be found. Aug 17 08:42:59.898370 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': 'eefed036-89ed-46ed-8d8d-ab6b8a9abfce'} Aug 17 08:42:59.899161 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:42:59.899161 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:42:59.899161 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:42:59.899161 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:42:59.899161 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:42:59.899161 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:42:59.899161 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:42:59.899161 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:42:59.899161 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:42:59.899161 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:42:59.899161 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eefed036-89ed-46ed-8d8d-ab6b8a9abfce could not be found. Aug 17 08:42:59.899161 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:42:59.899161 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:42:59.899161 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:42:59.899161 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:42:59.899161 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:42:59.899161 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:42:59.899161 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:42:59.899161 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:42:59.899161 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:42:59.900435 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:42:59.900435 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:42:59.900435 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:42:59.900435 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:42:59.900435 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:42:59.900435 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:42:59.900435 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:42:59.900435 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eefed036-89ed-46ed-8d8d-ab6b8a9abfce could not be found. Aug 17 08:42:59.900435 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:42:59.900435 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:42:59.900435 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:42:59.900435 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:42:59.900435 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:42:59.900435 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:42:59.900435 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:42:59.900435 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:42:59.900435 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eefed036-89ed-46ed-8d8d-ab6b8a9abfce could not be found. Aug 17 08:42:59.900435 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:42:59.901510 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b6d95796-6dc7-4657-a320-56a7be582e4e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Returning 404 to user: Instance eefed036-89ed-46ed-8d8d-ab6b8a9abfce could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:42:59.901510 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b6d95796-6dc7-4657-a320-56a7be582e4e tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce" status: 404 len: 111 microversion: 2.1 time: 0.034042 Aug 17 08:42:59.901510 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 259/516] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:42:59 2022] GET /compute/v2.1/servers/eefed036-89ed-46ed-8d8d-ab6b8a9abfce => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:42:59.907710 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-600dfd40-4a02-4bcc-9c8c-8676ab5e9988 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:42:59.908205 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-600dfd40-4a02-4bcc-9c8c-8676ab5e9988 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:42:59.914277 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-600dfd40-4a02-4bcc-9c8c-8676ab5e9988 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:59.915007 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-600dfd40-4a02-4bcc-9c8c-8676ab5e9988 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:59.915436 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-600dfd40-4a02-4bcc-9c8c-8676ab5e9988 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:59.916182 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-600dfd40-4a02-4bcc-9c8c-8676ab5e9988 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:42:59.916831 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-600dfd40-4a02-4bcc-9c8c-8676ab5e9988 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:42:59.917218 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-600dfd40-4a02-4bcc-9c8c-8676ab5e9988 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:42:59.941608 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-600dfd40-4a02-4bcc-9c8c-8676ab5e9988 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 08:43:00.013960 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-600dfd40-4a02-4bcc-9c8c-8676ab5e9988 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "DELETE /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 204 len: 0 microversion: 2.1 time: 0.109747 Aug 17 08:43:00.014657 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 258/517] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:42:59 2022] DELETE /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 08:43:00.022819 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3c23be36-9f09-4110-89ea-2522cbf0b328 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:00.023422 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3c23be36-9f09-4110-89ea-2522cbf0b328 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:00.029910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3c23be36-9f09-4110-89ea-2522cbf0b328 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:00.030382 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3c23be36-9f09-4110-89ea-2522cbf0b328 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:00.030816 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3c23be36-9f09-4110-89ea-2522cbf0b328 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:00.031486 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3c23be36-9f09-4110-89ea-2522cbf0b328 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:00.031974 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3c23be36-9f09-4110-89ea-2522cbf0b328 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:00.032387 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3c23be36-9f09-4110-89ea-2522cbf0b328 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:00.162452 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3c23be36-9f09-4110-89ea-2522cbf0b328 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:00.170388 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3c23be36-9f09-4110-89ea-2522cbf0b328 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1522 microversion: 2.1 time: 0.151324 Aug 17 08:43:00.170954 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 260/518] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:00 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:00.816883 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-65c99573-c50e-48ff-b4a3-06788ed36199 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:00.817492 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-65c99573-c50e-48ff-b4a3-06788ed36199 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:00.823727 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-65c99573-c50e-48ff-b4a3-06788ed36199 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:00.824194 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-65c99573-c50e-48ff-b4a3-06788ed36199 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:00.824693 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-65c99573-c50e-48ff-b4a3-06788ed36199 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:00.825359 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-65c99573-c50e-48ff-b4a3-06788ed36199 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:00.825798 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-65c99573-c50e-48ff-b4a3-06788ed36199 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:00.826208 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-65c99573-c50e-48ff-b4a3-06788ed36199 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:00.955127 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-65c99573-c50e-48ff-b4a3-06788ed36199 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:00.962527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-65c99573-c50e-48ff-b4a3-06788ed36199 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1569 microversion: 2.1 time: 0.150063 Aug 17 08:43:00.963084 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 259/519] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:00 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:01.190705 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ebe856cf-c1c9-4d8e-8dd6-0e475c61127b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:01.191310 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ebe856cf-c1c9-4d8e-8dd6-0e475c61127b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:01.197713 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ebe856cf-c1c9-4d8e-8dd6-0e475c61127b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:01.198189 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ebe856cf-c1c9-4d8e-8dd6-0e475c61127b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:01.198625 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ebe856cf-c1c9-4d8e-8dd6-0e475c61127b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:01.199301 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ebe856cf-c1c9-4d8e-8dd6-0e475c61127b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:01.199777 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ebe856cf-c1c9-4d8e-8dd6-0e475c61127b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:01.200195 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ebe856cf-c1c9-4d8e-8dd6-0e475c61127b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:01.202788 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:43:01.328649 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ebe856cf-c1c9-4d8e-8dd6-0e475c61127b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:01.336384 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ebe856cf-c1c9-4d8e-8dd6-0e475c61127b tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1522 microversion: 2.1 time: 0.149495 Aug 17 08:43:01.336946 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 261/520] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:01 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:01.983604 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-efba342c-25f7-417e-9219-84c9c856f51d tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:01.984201 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-efba342c-25f7-417e-9219-84c9c856f51d tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:01.990457 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-efba342c-25f7-417e-9219-84c9c856f51d tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:01.990928 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-efba342c-25f7-417e-9219-84c9c856f51d tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:01.991348 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-efba342c-25f7-417e-9219-84c9c856f51d tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:01.992043 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-efba342c-25f7-417e-9219-84c9c856f51d tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:01.992483 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-efba342c-25f7-417e-9219-84c9c856f51d tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:01.992894 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-efba342c-25f7-417e-9219-84c9c856f51d tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:02.124077 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-efba342c-25f7-417e-9219-84c9c856f51d tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:02.131737 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-efba342c-25f7-417e-9219-84c9c856f51d tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1569 microversion: 2.1 time: 0.151868 Aug 17 08:43:02.132301 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 260/521] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:01 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:02.357858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-aac4522d-e812-432d-af18-7e4f5ab20605 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:02.358463 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-aac4522d-e812-432d-af18-7e4f5ab20605 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:02.364876 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aac4522d-e812-432d-af18-7e4f5ab20605 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:02.365357 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aac4522d-e812-432d-af18-7e4f5ab20605 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:02.365795 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aac4522d-e812-432d-af18-7e4f5ab20605 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:02.366485 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aac4522d-e812-432d-af18-7e4f5ab20605 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:02.366938 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aac4522d-e812-432d-af18-7e4f5ab20605 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:02.367355 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aac4522d-e812-432d-af18-7e4f5ab20605 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:02.497434 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-aac4522d-e812-432d-af18-7e4f5ab20605 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:02.504828 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-aac4522d-e812-432d-af18-7e4f5ab20605 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1522 microversion: 2.1 time: 0.151337 Aug 17 08:43:02.505387 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 262/522] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:02 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:03.153171 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a84903b5-6e98-499a-b6a9-7a3c7fbf6eca tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:03.153791 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a84903b5-6e98-499a-b6a9-7a3c7fbf6eca tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:03.160389 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a84903b5-6e98-499a-b6a9-7a3c7fbf6eca tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:03.160919 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a84903b5-6e98-499a-b6a9-7a3c7fbf6eca tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:03.161329 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a84903b5-6e98-499a-b6a9-7a3c7fbf6eca tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:03.162128 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a84903b5-6e98-499a-b6a9-7a3c7fbf6eca tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:03.162575 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a84903b5-6e98-499a-b6a9-7a3c7fbf6eca tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:03.162991 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a84903b5-6e98-499a-b6a9-7a3c7fbf6eca tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:03.297047 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a84903b5-6e98-499a-b6a9-7a3c7fbf6eca tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:03.304570 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a84903b5-6e98-499a-b6a9-7a3c7fbf6eca tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1569 microversion: 2.1 time: 0.156119 Aug 17 08:43:03.305064 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 261/523] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:03 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:03.525199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1e3f344b-5345-40c6-a599-5637eeeba9d6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:03.525802 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1e3f344b-5345-40c6-a599-5637eeeba9d6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:03.532063 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1e3f344b-5345-40c6-a599-5637eeeba9d6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:03.532553 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1e3f344b-5345-40c6-a599-5637eeeba9d6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:03.532989 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1e3f344b-5345-40c6-a599-5637eeeba9d6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:03.533703 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1e3f344b-5345-40c6-a599-5637eeeba9d6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:03.534156 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1e3f344b-5345-40c6-a599-5637eeeba9d6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:03.534579 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1e3f344b-5345-40c6-a599-5637eeeba9d6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:03.744701 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-1e3f344b-5345-40c6-a599-5637eeeba9d6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051f99404fc4e0593553ae95e1f90d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3596b4a1404d3db340943fbd63567d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:03.752854 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1e3f344b-5345-40c6-a599-5637eeeba9d6 tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 200 len: 1522 microversion: 2.1 time: 0.231523 Aug 17 08:43:03.753420 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 263/524] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:03 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:04.049481 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-e68d23a0-aebd-4798-b5b1-1f086756122f req-15f77dac-af67-499e-a7c3-a6aa0742e5fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcce3821-0099-45bc-9283-1ad5632080ce", "name": "network-vif-deleted", "tag": "8843e2b2-9e74-4082-acb6-0b36b20085b1"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:43:04.058776 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-e68d23a0-aebd-4798-b5b1-1f086756122f req-15f77dac-af67-499e-a7c3-a6aa0742e5fe service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:04.059256 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-e68d23a0-aebd-4798-b5b1-1f086756122f req-15f77dac-af67-499e-a7c3-a6aa0742e5fe service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:04.059704 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-e68d23a0-aebd-4798-b5b1-1f086756122f req-15f77dac-af67-499e-a7c3-a6aa0742e5fe service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:04.070512 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-e68d23a0-aebd-4798-b5b1-1f086756122f req-15f77dac-af67-499e-a7c3-a6aa0742e5fe service nova] Creating event network-vif-deleted:8843e2b2-9e74-4082-acb6-0b36b20085b1 for instance fcce3821-0099-45bc-9283-1ad5632080ce on hv-cinder-85331 Aug 17 08:43:04.075343 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-e68d23a0-aebd-4798-b5b1-1f086756122f req-15f77dac-af67-499e-a7c3-a6aa0742e5fe service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029638 Aug 17 08:43:04.076103 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 262/525] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:43:04.325435 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e5a4b9f2-a77b-49bd-a1a8-8fa74ba09a91 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:04.326035 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e5a4b9f2-a77b-49bd-a1a8-8fa74ba09a91 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:04.332404 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e5a4b9f2-a77b-49bd-a1a8-8fa74ba09a91 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:04.332885 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e5a4b9f2-a77b-49bd-a1a8-8fa74ba09a91 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:04.333343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e5a4b9f2-a77b-49bd-a1a8-8fa74ba09a91 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:04.334033 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e5a4b9f2-a77b-49bd-a1a8-8fa74ba09a91 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:04.334472 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e5a4b9f2-a77b-49bd-a1a8-8fa74ba09a91 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:04.334895 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e5a4b9f2-a77b-49bd-a1a8-8fa74ba09a91 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:04.472544 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e5a4b9f2-a77b-49bd-a1a8-8fa74ba09a91 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:04.480102 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e5a4b9f2-a77b-49bd-a1a8-8fa74ba09a91 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1569 microversion: 2.1 time: 0.158510 Aug 17 08:43:04.480677 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 264/526] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:04 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:04.774667 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6b6415d7-90d1-409d-81be-de1cc0f05b9c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:04.775352 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6b6415d7-90d1-409d-81be-de1cc0f05b9c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] [instance: fcce3821-0099-45bc-9283-1ad5632080ce] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:04.781587 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6b6415d7-90d1-409d-81be-de1cc0f05b9c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:04.782067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6b6415d7-90d1-409d-81be-de1cc0f05b9c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:04.782498 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6b6415d7-90d1-409d-81be-de1cc0f05b9c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:04.783178 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6b6415d7-90d1-409d-81be-de1cc0f05b9c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:04.783655 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6b6415d7-90d1-409d-81be-de1cc0f05b9c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:04.784075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6b6415d7-90d1-409d-81be-de1cc0f05b9c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:04.797771 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-6b6415d7-90d1-409d-81be-de1cc0f05b9c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] HTTP exception thrown: Instance fcce3821-0099-45bc-9283-1ad5632080ce could not be found. Aug 17 08:43:04.799489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6b6415d7-90d1-409d-81be-de1cc0f05b9c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Request method failure captured: Aug 17 08:43:04.799489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce HTTP/1.1 Aug 17 08:43:04.799489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:43:04.799489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:43:04.799489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:43:04.799489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:43:04.799489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:43:04.799489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:43:04.799489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:43:04.799489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:43:04.799489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_Kji6Z6va2Uun3O7PfuwZB78DrFVBWntRNdu90xpb_V8I8QwVJ2kvC1hN3MJ79pVctymf4qsZ66__L6U-Av0K3yOggyHXxU1_rw06E-jph23OY_HLUrhK8ayFUMvsxgiYt2c7Y4q-1Au0PC8GFHJjVF0sKN8b-BkvnKkF76FNyXvPfQ Aug 17 08:43:04.799489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:43:04.799489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:43:04.799489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:43:04.799489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:43:04.799489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:43:04.799489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:43:04.799489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: 2f3596b4a1404d3db340943fbd63567d Aug 17 08:43:04.799489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-197889665 Aug 17 08:43:04.799489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:43:04.799489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:43:04.801198 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2f3596b4a1404d3db340943fbd63567d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2f3596b4a1404d3db340943fbd63567d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2f3596b4a1404d3db340943fbd63567d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2f3596b4a1404d3db340943fbd63567d", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:43:04.801198 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-ServerRescueNegativeTestJSON-197889665 Aug 17 08:43:04.801198 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 2f3596b4a1404d3db340943fbd63567d Aug 17 08:43:04.801198 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-197889665 Aug 17 08:43:04.801198 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-ServerRescueNegativeTestJSON-197889665-project Aug 17 08:43:04.801198 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:43:04.801198 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:43:04.801198 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: f051f99404fc4e0593553ae95e1f90d5 Aug 17 08:43:04.801198 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-ServerRescueNegativeTestJSON-197889665-project Aug 17 08:43:04.801198 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:43:04.801198 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Instance fcce3821-0099-45bc-9283-1ad5632080ce could not be found. Aug 17 08:43:04.801198 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'id': 'fcce3821-0099-45bc-9283-1ad5632080ce'} Aug 17 08:43:04.802203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:43:04.802203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:43:04.802203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:43:04.802203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:43:04.802203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:43:04.802203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:43:04.802203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:43:04.802203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:43:04.802203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:43:04.802203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:43:04.802203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcce3821-0099-45bc-9283-1ad5632080ce could not be found. Aug 17 08:43:04.802203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:43:04.802203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:43:04.802203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:43:04.802203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:43:04.802203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:43:04.802203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:43:04.802203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:43:04.802203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:43:04.802203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:43:04.803483 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:43:04.803483 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:43:04.803483 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:43:04.803483 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:43:04.803483 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:43:04.803483 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:43:04.803483 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:43:04.803483 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcce3821-0099-45bc-9283-1ad5632080ce could not be found. Aug 17 08:43:04.803483 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:43:04.803483 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:43:04.803483 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:43:04.803483 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:43:04.803483 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:43:04.803483 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:43:04.803483 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:43:04.803483 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:43:04.803483 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcce3821-0099-45bc-9283-1ad5632080ce could not be found. Aug 17 08:43:04.803483 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:43:04.804761 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6b6415d7-90d1-409d-81be-de1cc0f05b9c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] Returning 404 to user: Instance fcce3821-0099-45bc-9283-1ad5632080ce could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:43:04.804761 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6b6415d7-90d1-409d-81be-de1cc0f05b9c tempest-ServerRescueNegativeTestJSON-197889665 tempest-ServerRescueNegativeTestJSON-197889665-project] 10.222.0.15 "GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce" status: 404 len: 111 microversion: 2.1 time: 0.030945 Aug 17 08:43:04.804761 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 263/527] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:04 2022] GET /compute/v2.1/servers/fcce3821-0099-45bc-9283-1ad5632080ce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:43:05.501506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-61791d07-f684-4150-a9f3-7d879aff9fd0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:05.502134 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-61791d07-f684-4150-a9f3-7d879aff9fd0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:05.508862 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-61791d07-f684-4150-a9f3-7d879aff9fd0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:05.509338 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-61791d07-f684-4150-a9f3-7d879aff9fd0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:05.509763 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-61791d07-f684-4150-a9f3-7d879aff9fd0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:05.510437 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-61791d07-f684-4150-a9f3-7d879aff9fd0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:05.510931 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-61791d07-f684-4150-a9f3-7d879aff9fd0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:05.511344 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-61791d07-f684-4150-a9f3-7d879aff9fd0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:05.642630 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-61791d07-f684-4150-a9f3-7d879aff9fd0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:05.650274 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-61791d07-f684-4150-a9f3-7d879aff9fd0 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1569 microversion: 2.1 time: 0.152937 Aug 17 08:43:05.650846 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 265/528] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:05 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:06.670329 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6c5b114c-6057-4888-961f-b07393f412d8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:06.671008 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6c5b114c-6057-4888-961f-b07393f412d8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:06.677730 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6c5b114c-6057-4888-961f-b07393f412d8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:06.678210 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6c5b114c-6057-4888-961f-b07393f412d8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:06.678641 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6c5b114c-6057-4888-961f-b07393f412d8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:06.679326 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6c5b114c-6057-4888-961f-b07393f412d8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:06.679804 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6c5b114c-6057-4888-961f-b07393f412d8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:06.680220 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6c5b114c-6057-4888-961f-b07393f412d8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:06.896069 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6c5b114c-6057-4888-961f-b07393f412d8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:06.904843 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6c5b114c-6057-4888-961f-b07393f412d8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1569 microversion: 2.1 time: 0.238436 Aug 17 08:43:06.905401 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 264/529] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:06 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1569 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:07.927269 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f42d7951-6b9f-4262-bce3-5c6706f902dc tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:07.927916 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f42d7951-6b9f-4262-bce3-5c6706f902dc tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:07.936828 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f42d7951-6b9f-4262-bce3-5c6706f902dc tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:07.939952 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f42d7951-6b9f-4262-bce3-5c6706f902dc tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:07.941035 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f42d7951-6b9f-4262-bce3-5c6706f902dc tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:07.942197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f42d7951-6b9f-4262-bce3-5c6706f902dc tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:07.942966 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f42d7951-6b9f-4262-bce3-5c6706f902dc tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:07.943646 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f42d7951-6b9f-4262-bce3-5c6706f902dc tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:08.114457 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-f42d7951-6b9f-4262-bce3-5c6706f902dc tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:08.123450 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f42d7951-6b9f-4262-bce3-5c6706f902dc tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1569 microversion: 2.1 time: 0.200200 Aug 17 08:43:08.131671 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 266/530] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:07 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:09.144307 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-18c5993b-a5a3-475b-831d-f242e3603dba tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:09.145440 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-18c5993b-a5a3-475b-831d-f242e3603dba tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:09.152364 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-18c5993b-a5a3-475b-831d-f242e3603dba tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:09.152836 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-18c5993b-a5a3-475b-831d-f242e3603dba tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:09.153454 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-18c5993b-a5a3-475b-831d-f242e3603dba tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:09.154139 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-18c5993b-a5a3-475b-831d-f242e3603dba tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:09.154581 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-18c5993b-a5a3-475b-831d-f242e3603dba tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:09.155177 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-18c5993b-a5a3-475b-831d-f242e3603dba tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:09.336463 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-18c5993b-a5a3-475b-831d-f242e3603dba tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:09.344985 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-18c5993b-a5a3-475b-831d-f242e3603dba tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1569 microversion: 2.1 time: 0.204342 Aug 17 08:43:09.345673 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 265/531] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:09 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:10.366097 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e3004792-ae96-440d-b550-8749d29dbc44 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:10.366691 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e3004792-ae96-440d-b550-8749d29dbc44 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:10.375019 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e3004792-ae96-440d-b550-8749d29dbc44 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:10.375492 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e3004792-ae96-440d-b550-8749d29dbc44 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:10.376368 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e3004792-ae96-440d-b550-8749d29dbc44 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:10.377585 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e3004792-ae96-440d-b550-8749d29dbc44 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:10.377585 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e3004792-ae96-440d-b550-8749d29dbc44 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:10.381204 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e3004792-ae96-440d-b550-8749d29dbc44 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:10.643572 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e3004792-ae96-440d-b550-8749d29dbc44 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:10.652065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e3004792-ae96-440d-b550-8749d29dbc44 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1569 microversion: 2.1 time: 0.289642 Aug 17 08:43:10.652642 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 267/532] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:10 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1569 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:10.858280 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-af48c4df-4e27-47f4-b657-6681a2599c6e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:10.858786 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-af48c4df-4e27-47f4-b657-6681a2599c6e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:10.866877 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-af48c4df-4e27-47f4-b657-6681a2599c6e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:10.867563 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-af48c4df-4e27-47f4-b657-6681a2599c6e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:10.867990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-af48c4df-4e27-47f4-b657-6681a2599c6e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:10.868676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-af48c4df-4e27-47f4-b657-6681a2599c6e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:10.869120 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-af48c4df-4e27-47f4-b657-6681a2599c6e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:10.869529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-af48c4df-4e27-47f4-b657-6681a2599c6e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:10.893138 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-af48c4df-4e27-47f4-b657-6681a2599c6e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/ips" status: 200 len: 145 microversion: 2.1 time: 0.277941 Aug 17 08:43:10.893713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 266/533] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 08:43:10 2022] GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/ips => generated 145 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:43:11.677652 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-72cffe49-64f0-4da4-9213-2f6e6fe67c9c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:11.680613 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-72cffe49-64f0-4da4-9213-2f6e6fe67c9c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:11.692884 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-72cffe49-64f0-4da4-9213-2f6e6fe67c9c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:11.693715 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-72cffe49-64f0-4da4-9213-2f6e6fe67c9c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:11.694496 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-72cffe49-64f0-4da4-9213-2f6e6fe67c9c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:11.696911 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-72cffe49-64f0-4da4-9213-2f6e6fe67c9c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:11.697729 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-72cffe49-64f0-4da4-9213-2f6e6fe67c9c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:11.699202 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-72cffe49-64f0-4da4-9213-2f6e6fe67c9c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:11.867609 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-72cffe49-64f0-4da4-9213-2f6e6fe67c9c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:11.877549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-72cffe49-64f0-4da4-9213-2f6e6fe67c9c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1569 microversion: 2.1 time: 0.206820 Aug 17 08:43:11.879889 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 268/534] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:11 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:12.270817 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9a9ca738-59be-4db0-a088-a75b95b5eae2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac4ef9c0-b592-4dd1-b7dd-cbaaeff68890"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:43:12.273800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9a9ca738-59be-4db0-a088-a75b95b5eae2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:12.281057 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9a9ca738-59be-4db0-a088-a75b95b5eae2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:12.281780 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9a9ca738-59be-4db0-a088-a75b95b5eae2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:12.283215 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9a9ca738-59be-4db0-a088-a75b95b5eae2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:12.284102 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9a9ca738-59be-4db0-a088-a75b95b5eae2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:12.284558 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9a9ca738-59be-4db0-a088-a75b95b5eae2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:12.284981 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9a9ca738-59be-4db0-a088-a75b95b5eae2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:12.671770 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9a9ca738-59be-4db0-a088-a75b95b5eae2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "POST /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.404449 Aug 17 08:43:12.673320 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 267/535] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 08:43:12 2022] POST /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/os-volume_attachments => generated 194 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:43:12.898319 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f4a4892e-6c97-4557-b737-467f71b0783a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:12.898909 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f4a4892e-6c97-4557-b737-467f71b0783a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:12.907872 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f4a4892e-6c97-4557-b737-467f71b0783a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:12.908369 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f4a4892e-6c97-4557-b737-467f71b0783a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:12.908805 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f4a4892e-6c97-4557-b737-467f71b0783a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:12.909506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f4a4892e-6c97-4557-b737-467f71b0783a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:12.909997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f4a4892e-6c97-4557-b737-467f71b0783a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:12.910727 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f4a4892e-6c97-4557-b737-467f71b0783a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:13.061778 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-f4a4892e-6c97-4557-b737-467f71b0783a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:13.069672 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f4a4892e-6c97-4557-b737-467f71b0783a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1510 microversion: 2.1 time: 0.175113 Aug 17 08:43:13.070688 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 269/536] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:12 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:13.096941 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-7afe04ce-a515-4fe2-8b97-a5e44b2a8da3 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:43:13.097776 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7afe04ce-a515-4fe2-8b97-a5e44b2a8da3 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:13.104808 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7afe04ce-a515-4fe2-8b97-a5e44b2a8da3 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:13.105798 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7afe04ce-a515-4fe2-8b97-a5e44b2a8da3 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:13.106613 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7afe04ce-a515-4fe2-8b97-a5e44b2a8da3 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:13.107554 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7afe04ce-a515-4fe2-8b97-a5e44b2a8da3 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:13.108231 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7afe04ce-a515-4fe2-8b97-a5e44b2a8da3 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:13.108856 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7afe04ce-a515-4fe2-8b97-a5e44b2a8da3 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:13.257053 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7afe04ce-a515-4fe2-8b97-a5e44b2a8da3 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127298) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 08:43:13.346741 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-7afe04ce-a515-4fe2-8b97-a5e44b2a8da3 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "POST /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1/action" status: 202 len: 0 microversion: 2.1 time: 0.256111 Aug 17 08:43:13.347690 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 268/537] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 08:43:13 2022] POST /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:43:13.358750 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b419a9b6-5ca4-42f0-b7f6-381b0c78e11c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:13.359722 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b419a9b6-5ca4-42f0-b7f6-381b0c78e11c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:13.366000 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b419a9b6-5ca4-42f0-b7f6-381b0c78e11c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:13.366557 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b419a9b6-5ca4-42f0-b7f6-381b0c78e11c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:13.367369 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b419a9b6-5ca4-42f0-b7f6-381b0c78e11c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:13.368205 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b419a9b6-5ca4-42f0-b7f6-381b0c78e11c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:13.368533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b419a9b6-5ca4-42f0-b7f6-381b0c78e11c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:13.369242 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b419a9b6-5ca4-42f0-b7f6-381b0c78e11c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:13.373014 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-51d6df34-fa5f-43c2-b9dc-bcd7bb723725 req-be33c78e-48eb-4c45-a977-853b21bf7792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe1b2a32-cde6-43da-885e-78a42a55a7f1", "name": "network-vif-unplugged", "status": "completed", "tag": "26fa0a6d-8a86-40e7-a48f-d1b7d96cfcfb"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:43:13.392729 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-51d6df34-fa5f-43c2-b9dc-bcd7bb723725 req-be33c78e-48eb-4c45-a977-853b21bf7792 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:13.394882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-51d6df34-fa5f-43c2-b9dc-bcd7bb723725 req-be33c78e-48eb-4c45-a977-853b21bf7792 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:13.396480 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-51d6df34-fa5f-43c2-b9dc-bcd7bb723725 req-be33c78e-48eb-4c45-a977-853b21bf7792 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:13.420840 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.compute.server_external_events [req-51d6df34-fa5f-43c2-b9dc-bcd7bb723725 req-be33c78e-48eb-4c45-a977-853b21bf7792 service nova] Unable to find a host for instance fe1b2a32-cde6-43da-885e-78a42a55a7f1. Dropping event network-vif-unplugged {{(pid=127298) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 17 08:43:13.422870 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-51d6df34-fa5f-43c2-b9dc-bcd7bb723725 req-be33c78e-48eb-4c45-a977-853b21bf7792 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.054512 Aug 17 08:43:13.426868 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 269/538] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 59 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 17 08:43:13.542219 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b419a9b6-5ca4-42f0-b7f6-381b0c78e11c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:13.550352 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5d25e80f-4896-436f-b30c-1fa3ede6df16 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Action: 'create', calling method: .version_select at 0x7f3f8535d9d0>, body: {"keypair": {"name": "tempest-keypair-489707631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGrr9P1RpjSBz8AYgPshyeUAZrnUm1u8X4C/eNG1oSYl9V1/dYD3PeMZE/NH4yWTALAcCODPV2JgXfPDHahnmgbF+3vbWRomEvdqzlMUoirAYpA7lTjcWEoCTwsu+P9oA=="}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:43:13.562819 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b419a9b6-5ca4-42f0-b7f6-381b0c78e11c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1518 microversion: 2.1 time: 0.210893 Aug 17 08:43:13.563941 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 270/539] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:13 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1518 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:13.575106 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-5d25e80f-4896-436f-b30c-1fa3ede6df16 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Getting quotas for project eb857c94e3f6405baad84dfc45445b0d. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:43:13.579464 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-5d25e80f-4896-436f-b30c-1fa3ede6df16 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Getting quotas for user d586af36267c475ab5af42a23ce3f1b1 and project eb857c94e3f6405baad84dfc45445b0d. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:43:13.613958 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5d25e80f-4896-436f-b30c-1fa3ede6df16 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.133257 Aug 17 08:43:13.614601 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 270/540] 10.222.0.15 () {62 vars in 1200 bytes} [Wed Aug 17 08:43:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 135 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 17 08:43:14.586367 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2c5ce22d-699a-4d73-a093-7798e5ce5eeb tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:14.592706 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-2c5ce22d-699a-4d73-a093-7798e5ce5eeb tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:14.601510 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2c5ce22d-699a-4d73-a093-7798e5ce5eeb tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:14.602804 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2c5ce22d-699a-4d73-a093-7798e5ce5eeb tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:14.603409 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2c5ce22d-699a-4d73-a093-7798e5ce5eeb tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:14.604381 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2c5ce22d-699a-4d73-a093-7798e5ce5eeb tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:14.604998 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2c5ce22d-699a-4d73-a093-7798e5ce5eeb tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:14.605645 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2c5ce22d-699a-4d73-a093-7798e5ce5eeb tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:14.830907 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-2c5ce22d-699a-4d73-a093-7798e5ce5eeb tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:14.840274 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2c5ce22d-699a-4d73-a093-7798e5ce5eeb tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1520 microversion: 2.1 time: 0.258959 Aug 17 08:43:14.841308 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 271/541] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:14 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:15.582497 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-091a5640-fb7f-4ec8-be51-1ebb34027e8c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-886029691", "imageRef": "4467450c-a35c-42e3-af85-a13291b0b2aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d158ee5-e6fd-41a5-a1ba-f67b7981b1e8"}], "security_groups": [{"name": "tempest-securitygroup--861338060"}], "key_name": "tempest-keypair-489707631", "user_data": "}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:43:15.591406 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:43:15.692338 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.network.neutron [None req-091a5640-fb7f-4ec8-be51-1ebb34027e8c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] validate_networks() for [('0d158ee5-e6fd-41a5-a1ba-f67b7981b1e8', None, None, None, None, None)] {{(pid=127298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 08:43:15.862862 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-afa8ed8f-977c-438b-9804-86b8b67fcbf2 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:15.863439 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-afa8ed8f-977c-438b-9804-86b8b67fcbf2 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:15.869371 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-afa8ed8f-977c-438b-9804-86b8b67fcbf2 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:15.869893 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-afa8ed8f-977c-438b-9804-86b8b67fcbf2 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:15.870320 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-afa8ed8f-977c-438b-9804-86b8b67fcbf2 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:15.871013 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-afa8ed8f-977c-438b-9804-86b8b67fcbf2 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:15.871520 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-afa8ed8f-977c-438b-9804-86b8b67fcbf2 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:15.872260 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-afa8ed8f-977c-438b-9804-86b8b67fcbf2 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:16.050771 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-afa8ed8f-977c-438b-9804-86b8b67fcbf2 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:16.059049 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-afa8ed8f-977c-438b-9804-86b8b67fcbf2 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1520 microversion: 2.1 time: 0.200659 Aug 17 08:43:16.059632 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 272/542] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:15 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:43:16.074368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-091a5640-fb7f-4ec8-be51-1ebb34027e8c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Flavor limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 08:43:16.074784 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-091a5640-fb7f-4ec8-be51-1ebb34027e8c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Image limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 08:43:16.075242 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-091a5640-fb7f-4ec8-be51-1ebb34027e8c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Flavor pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 08:43:16.075784 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-091a5640-fb7f-4ec8-be51-1ebb34027e8c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Image pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 08:43:16.076193 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-091a5640-fb7f-4ec8-be51-1ebb34027e8c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 08:43:16.085526 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-091a5640-fb7f-4ec8-be51-1ebb34027e8c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:16.086083 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-091a5640-fb7f-4ec8-be51-1ebb34027e8c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:16.086578 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-091a5640-fb7f-4ec8-be51-1ebb34027e8c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:16.087355 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-091a5640-fb7f-4ec8-be51-1ebb34027e8c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:16.087924 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-091a5640-fb7f-4ec8-be51-1ebb34027e8c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:16.088441 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-091a5640-fb7f-4ec8-be51-1ebb34027e8c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:16.107471 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-091a5640-fb7f-4ec8-be51-1ebb34027e8c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Getting quotas for project eb857c94e3f6405baad84dfc45445b0d. Resources: {'cores', 'instances', 'ram'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:43:16.111780 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-091a5640-fb7f-4ec8-be51-1ebb34027e8c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Getting quotas for user d586af36267c475ab5af42a23ce3f1b1 and project eb857c94e3f6405baad84dfc45445b0d. Resources: {'cores', 'instances', 'ram'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:43:16.124341 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-091a5640-fb7f-4ec8-be51-1ebb34027e8c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Going to run 1 instances... {{(pid=127298) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 08:43:16.126690 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-091a5640-fb7f-4ec8-be51-1ebb34027e8c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4467450c-a35c-42e3-af85-a13291b0b2aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 08:43:16.175594 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-091a5640-fb7f-4ec8-be51-1ebb34027e8c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.598140 Aug 17 08:43:16.176527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 271/543] 10.222.0.15 () {62 vars in 1188 bytes} [Wed Aug 17 08:43:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 17 08:43:16.188205 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ce8f4374-bdef-4973-b498-555a55351d63 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:16.188904 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ce8f4374-bdef-4973-b498-555a55351d63 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:16.261234 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ce8f4374-bdef-4973-b498-555a55351d63 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:16.269477 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ce8f4374-bdef-4973-b498-555a55351d63 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:16.271299 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ce8f4374-bdef-4973-b498-555a55351d63 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:16.272514 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ce8f4374-bdef-4973-b498-555a55351d63 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1280 microversion: 2.20 time: 0.088421 Aug 17 08:43:16.273479 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 273/544] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:43:16 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1280 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:43:17.080971 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-39b4abc4-c3dc-4c76-9a45-bd90577814a2 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:17.081520 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-39b4abc4-c3dc-4c76-9a45-bd90577814a2 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:17.088710 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39b4abc4-c3dc-4c76-9a45-bd90577814a2 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:17.089190 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39b4abc4-c3dc-4c76-9a45-bd90577814a2 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:17.089623 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39b4abc4-c3dc-4c76-9a45-bd90577814a2 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:17.090309 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39b4abc4-c3dc-4c76-9a45-bd90577814a2 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:17.090936 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39b4abc4-c3dc-4c76-9a45-bd90577814a2 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:17.091355 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39b4abc4-c3dc-4c76-9a45-bd90577814a2 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:17.095702 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:43:17.240342 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-39b4abc4-c3dc-4c76-9a45-bd90577814a2 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:17.252242 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-39b4abc4-c3dc-4c76-9a45-bd90577814a2 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1520 microversion: 2.1 time: 0.175936 Aug 17 08:43:17.252829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 272/545] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:17 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:43:17.296450 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6a9380b9-9287-4d6f-afbe-7b14cd6d4203 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:17.297285 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6a9380b9-9287-4d6f-afbe-7b14cd6d4203 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:17.311865 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a9380b9-9287-4d6f-afbe-7b14cd6d4203 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:17.312431 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a9380b9-9287-4d6f-afbe-7b14cd6d4203 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:17.312982 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a9380b9-9287-4d6f-afbe-7b14cd6d4203 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:17.313711 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a9380b9-9287-4d6f-afbe-7b14cd6d4203 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:17.314160 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a9380b9-9287-4d6f-afbe-7b14cd6d4203 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:17.314587 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6a9380b9-9287-4d6f-afbe-7b14cd6d4203 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:17.390986 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6a9380b9-9287-4d6f-afbe-7b14cd6d4203 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:17.400207 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6a9380b9-9287-4d6f-afbe-7b14cd6d4203 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:17.402067 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6a9380b9-9287-4d6f-afbe-7b14cd6d4203 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:17.403486 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6a9380b9-9287-4d6f-afbe-7b14cd6d4203 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1340 microversion: 2.20 time: 0.112771 Aug 17 08:43:17.419159 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 274/546] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:43:17 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1340 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:43:18.274164 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-776f356e-c507-44a4-9e3e-53d978141bf8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:18.274770 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-776f356e-c507-44a4-9e3e-53d978141bf8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:18.281768 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-776f356e-c507-44a4-9e3e-53d978141bf8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:18.282248 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-776f356e-c507-44a4-9e3e-53d978141bf8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:18.282680 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-776f356e-c507-44a4-9e3e-53d978141bf8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:18.283365 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-776f356e-c507-44a4-9e3e-53d978141bf8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:18.283844 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-776f356e-c507-44a4-9e3e-53d978141bf8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:18.284262 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-776f356e-c507-44a4-9e3e-53d978141bf8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:18.424878 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-776f356e-c507-44a4-9e3e-53d978141bf8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:18.426511 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8463897e-0882-47f0-bb96-d4f812467c5a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:18.427298 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8463897e-0882-47f0-bb96-d4f812467c5a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:18.432913 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:43:18.434142 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-776f356e-c507-44a4-9e3e-53d978141bf8 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1520 microversion: 2.1 time: 0.163665 Aug 17 08:43:18.434764 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 273/547] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:18 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:18.435306 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8463897e-0882-47f0-bb96-d4f812467c5a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:18.435901 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8463897e-0882-47f0-bb96-d4f812467c5a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:18.436568 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8463897e-0882-47f0-bb96-d4f812467c5a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:18.437492 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8463897e-0882-47f0-bb96-d4f812467c5a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:18.438028 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8463897e-0882-47f0-bb96-d4f812467c5a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:18.438659 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8463897e-0882-47f0-bb96-d4f812467c5a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:18.688899 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8463897e-0882-47f0-bb96-d4f812467c5a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:18.698701 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8463897e-0882-47f0-bb96-d4f812467c5a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:18.700618 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8463897e-0882-47f0-bb96-d4f812467c5a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:18.702062 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8463897e-0882-47f0-bb96-d4f812467c5a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1405 microversion: 2.20 time: 0.279650 Aug 17 08:43:18.703749 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 275/548] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:43:18 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1405 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 08:43:18.913570 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-0cbf125e-fa7c-4c44-8101-0d7c7d670f20 req-89473dd0-0262-47d0-9742-a1ebb016e8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42e06cf4-bb49-4d51-93c1-3147069bd032", "tag": "bc2b2be5-4c28-489f-8bda-05bbb62b4e19"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:43:18.922640 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-0cbf125e-fa7c-4c44-8101-0d7c7d670f20 req-89473dd0-0262-47d0-9742-a1ebb016e8d3 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:18.923104 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-0cbf125e-fa7c-4c44-8101-0d7c7d670f20 req-89473dd0-0262-47d0-9742-a1ebb016e8d3 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:18.923518 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-0cbf125e-fa7c-4c44-8101-0d7c7d670f20 req-89473dd0-0262-47d0-9742-a1ebb016e8d3 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:18.933793 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-0cbf125e-fa7c-4c44-8101-0d7c7d670f20 req-89473dd0-0262-47d0-9742-a1ebb016e8d3 service nova] Creating event network-changed:bc2b2be5-4c28-489f-8bda-05bbb62b4e19 for instance 42e06cf4-bb49-4d51-93c1-3147069bd032 on hv-cinder-85331 Aug 17 08:43:18.939264 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-0cbf125e-fa7c-4c44-8101-0d7c7d670f20 req-89473dd0-0262-47d0-9742-a1ebb016e8d3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082892 Aug 17 08:43:18.939879 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 274/549] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:43:19.454682 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-620664ad-a8a3-4cef-8dd8-0be143a8f700 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:19.455279 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-620664ad-a8a3-4cef-8dd8-0be143a8f700 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:19.461533 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-620664ad-a8a3-4cef-8dd8-0be143a8f700 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:19.462007 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-620664ad-a8a3-4cef-8dd8-0be143a8f700 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:19.462427 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-620664ad-a8a3-4cef-8dd8-0be143a8f700 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:19.463093 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-620664ad-a8a3-4cef-8dd8-0be143a8f700 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:19.463583 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-620664ad-a8a3-4cef-8dd8-0be143a8f700 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:19.463969 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-620664ad-a8a3-4cef-8dd8-0be143a8f700 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:19.673206 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-620664ad-a8a3-4cef-8dd8-0be143a8f700 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:19.682923 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-620664ad-a8a3-4cef-8dd8-0be143a8f700 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1520 microversion: 2.1 time: 0.231600 Aug 17 08:43:19.683488 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 276/550] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:19 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:19.727169 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c616f4ee-d362-41e0-bf05-d69ed1ec8e5c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:19.727912 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c616f4ee-d362-41e0-bf05-d69ed1ec8e5c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:19.734921 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c616f4ee-d362-41e0-bf05-d69ed1ec8e5c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:19.735917 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c616f4ee-d362-41e0-bf05-d69ed1ec8e5c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:19.736327 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c616f4ee-d362-41e0-bf05-d69ed1ec8e5c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:19.737388 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c616f4ee-d362-41e0-bf05-d69ed1ec8e5c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:19.737947 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c616f4ee-d362-41e0-bf05-d69ed1ec8e5c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:19.738377 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c616f4ee-d362-41e0-bf05-d69ed1ec8e5c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:19.899706 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c616f4ee-d362-41e0-bf05-d69ed1ec8e5c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:19.909374 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c616f4ee-d362-41e0-bf05-d69ed1ec8e5c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:19.911021 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c616f4ee-d362-41e0-bf05-d69ed1ec8e5c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:19.912433 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c616f4ee-d362-41e0-bf05-d69ed1ec8e5c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1405 microversion: 2.20 time: 0.189567 Aug 17 08:43:19.913072 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 275/551] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:43:19 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1405 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:43:20.310187 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-921934e0-b780-402b-bedc-d35683623718 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:20.312481 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-921934e0-b780-402b-bedc-d35683623718 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:20.318452 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-921934e0-b780-402b-bedc-d35683623718 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:20.318934 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-921934e0-b780-402b-bedc-d35683623718 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:20.319367 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-921934e0-b780-402b-bedc-d35683623718 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:20.320079 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-921934e0-b780-402b-bedc-d35683623718 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:20.320532 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-921934e0-b780-402b-bedc-d35683623718 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:20.320953 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-921934e0-b780-402b-bedc-d35683623718 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:20.350140 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-921934e0-b780-402b-bedc-d35683623718 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044538 Aug 17 08:43:20.350697 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 277/552] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 08:43:20 2022] GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:43:20.361851 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3127d44a-7999-446e-83d1-2c221940d0dd tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:20.362334 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3127d44a-7999-446e-83d1-2c221940d0dd tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:20.368202 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3127d44a-7999-446e-83d1-2c221940d0dd tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:20.368678 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3127d44a-7999-446e-83d1-2c221940d0dd tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:20.369102 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3127d44a-7999-446e-83d1-2c221940d0dd tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:20.370454 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3127d44a-7999-446e-83d1-2c221940d0dd tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:20.370897 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3127d44a-7999-446e-83d1-2c221940d0dd tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:20.371311 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3127d44a-7999-446e-83d1-2c221940d0dd tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:20.398852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3127d44a-7999-446e-83d1-2c221940d0dd tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/os-volume_attachments/ac4ef9c0-b592-4dd1-b7dd-cbaaeff68890" status: 200 len: 194 microversion: 2.1 time: 0.041057 Aug 17 08:43:20.399419 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 276/553] 10.222.0.15 () {58 vars in 1413 bytes} [Wed Aug 17 08:43:20 2022] GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/os-volume_attachments/ac4ef9c0-b592-4dd1-b7dd-cbaaeff68890 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:43:20.703619 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f6bc322b-9abb-481a-9e4e-9896532aaf8e tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:20.705027 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f6bc322b-9abb-481a-9e4e-9896532aaf8e tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:20.711382 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f6bc322b-9abb-481a-9e4e-9896532aaf8e tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:20.711909 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f6bc322b-9abb-481a-9e4e-9896532aaf8e tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:20.712335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f6bc322b-9abb-481a-9e4e-9896532aaf8e tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:20.713712 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f6bc322b-9abb-481a-9e4e-9896532aaf8e tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:20.714027 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f6bc322b-9abb-481a-9e4e-9896532aaf8e tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:20.714443 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f6bc322b-9abb-481a-9e4e-9896532aaf8e tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:20.843469 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-f6bc322b-9abb-481a-9e4e-9896532aaf8e tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:20.845783 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=100 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:43:20.852131 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f6bc322b-9abb-481a-9e4e-9896532aaf8e tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1576 microversion: 2.1 time: 0.152439 Aug 17 08:43:20.852697 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 278/554] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:20 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:20.936471 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e5f42a80-ddae-4847-8b48-6fb8a22131ae tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:20.937024 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e5f42a80-ddae-4847-8b48-6fb8a22131ae tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:20.943389 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e5f42a80-ddae-4847-8b48-6fb8a22131ae tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:20.943906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e5f42a80-ddae-4847-8b48-6fb8a22131ae tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:20.944347 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e5f42a80-ddae-4847-8b48-6fb8a22131ae tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:20.945037 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e5f42a80-ddae-4847-8b48-6fb8a22131ae tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:20.945488 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e5f42a80-ddae-4847-8b48-6fb8a22131ae tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:20.945907 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e5f42a80-ddae-4847-8b48-6fb8a22131ae tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:21.086939 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e5f42a80-ddae-4847-8b48-6fb8a22131ae tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:21.095482 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e5f42a80-ddae-4847-8b48-6fb8a22131ae tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:21.097019 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e5f42a80-ddae-4847-8b48-6fb8a22131ae tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:21.098118 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e5f42a80-ddae-4847-8b48-6fb8a22131ae tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1405 microversion: 2.20 time: 0.166347 Aug 17 08:43:21.098681 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 277/555] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:43:20 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:43:21.742563 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-60f89034-ac28-400d-8f76-858d651f6c5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "845806db-f208-4932-a4af-8e63bc001ab9"}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:43:21.745455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-60f89034-ac28-400d-8f76-858d651f6c5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:21.751746 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-60f89034-ac28-400d-8f76-858d651f6c5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:21.752220 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-60f89034-ac28-400d-8f76-858d651f6c5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:21.752646 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-60f89034-ac28-400d-8f76-858d651f6c5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:21.753351 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-60f89034-ac28-400d-8f76-858d651f6c5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:21.753798 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-60f89034-ac28-400d-8f76-858d651f6c5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:21.754206 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-60f89034-ac28-400d-8f76-858d651f6c5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:21.874025 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-25d338aa-397f-45a2-a20a-1a03946b08d7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:21.874746 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-25d338aa-397f-45a2-a20a-1a03946b08d7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:21.881063 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-25d338aa-397f-45a2-a20a-1a03946b08d7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:21.881548 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-25d338aa-397f-45a2-a20a-1a03946b08d7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:21.882207 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-25d338aa-397f-45a2-a20a-1a03946b08d7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:21.882879 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-25d338aa-397f-45a2-a20a-1a03946b08d7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:21.883332 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-25d338aa-397f-45a2-a20a-1a03946b08d7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:21.883791 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-25d338aa-397f-45a2-a20a-1a03946b08d7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:22.018985 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-25d338aa-397f-45a2-a20a-1a03946b08d7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:22.021091 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-60f89034-ac28-400d-8f76-858d651f6c5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "POST /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282028 Aug 17 08:43:22.021723 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 279/556] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 08:43:21 2022] POST /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:43:22.027173 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-25d338aa-397f-45a2-a20a-1a03946b08d7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1576 microversion: 2.1 time: 0.157659 Aug 17 08:43:22.027811 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 278/557] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:21 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:43:22.120397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a24e2845-0571-4ec1-8047-6b1891c55342 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:22.121083 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a24e2845-0571-4ec1-8047-6b1891c55342 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:22.127644 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a24e2845-0571-4ec1-8047-6b1891c55342 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:22.128119 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a24e2845-0571-4ec1-8047-6b1891c55342 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:22.128542 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a24e2845-0571-4ec1-8047-6b1891c55342 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:22.129252 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a24e2845-0571-4ec1-8047-6b1891c55342 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:22.129750 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a24e2845-0571-4ec1-8047-6b1891c55342 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:22.130130 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a24e2845-0571-4ec1-8047-6b1891c55342 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:22.262817 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a24e2845-0571-4ec1-8047-6b1891c55342 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:22.270609 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a24e2845-0571-4ec1-8047-6b1891c55342 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:22.272140 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a24e2845-0571-4ec1-8047-6b1891c55342 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:22.273217 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a24e2845-0571-4ec1-8047-6b1891c55342 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1405 microversion: 2.20 time: 0.157117 Aug 17 08:43:22.273764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 280/558] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:43:22 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:43:23.055940 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-fed422f1-b9b3-410a-a1cb-c1aeef4ff5f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:23.056540 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-fed422f1-b9b3-410a-a1cb-c1aeef4ff5f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:23.062874 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fed422f1-b9b3-410a-a1cb-c1aeef4ff5f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:23.063351 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fed422f1-b9b3-410a-a1cb-c1aeef4ff5f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:23.063821 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fed422f1-b9b3-410a-a1cb-c1aeef4ff5f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:23.064497 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fed422f1-b9b3-410a-a1cb-c1aeef4ff5f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:23.064947 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fed422f1-b9b3-410a-a1cb-c1aeef4ff5f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:23.065364 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fed422f1-b9b3-410a-a1cb-c1aeef4ff5f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:23.205783 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-fed422f1-b9b3-410a-a1cb-c1aeef4ff5f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:23.215052 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-fed422f1-b9b3-410a-a1cb-c1aeef4ff5f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1576 microversion: 2.1 time: 0.162869 Aug 17 08:43:23.215774 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 279/559] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:23 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:23.288311 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-664e4e24-b74d-4ec9-bde4-d53bee6b36bf req-6dd69c17-b327-42bf-9b4f-759139a40b1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e06cf4-bb49-4d51-93c1-3147069bd032", "name": "network-vif-plugged", "status": "completed", "tag": "bc2b2be5-4c28-489f-8bda-05bbb62b4e19"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:43:23.296527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-abc72440-1644-44fd-8d28-191b89c446dc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:23.297448 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-abc72440-1644-44fd-8d28-191b89c446dc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:23.298806 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-664e4e24-b74d-4ec9-bde4-d53bee6b36bf req-6dd69c17-b327-42bf-9b4f-759139a40b1c service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:23.299251 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-664e4e24-b74d-4ec9-bde4-d53bee6b36bf req-6dd69c17-b327-42bf-9b4f-759139a40b1c service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:23.299716 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-664e4e24-b74d-4ec9-bde4-d53bee6b36bf req-6dd69c17-b327-42bf-9b4f-759139a40b1c service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:23.309215 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-abc72440-1644-44fd-8d28-191b89c446dc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:23.309633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-abc72440-1644-44fd-8d28-191b89c446dc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:23.310132 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-abc72440-1644-44fd-8d28-191b89c446dc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:23.310835 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-abc72440-1644-44fd-8d28-191b89c446dc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:23.311288 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-abc72440-1644-44fd-8d28-191b89c446dc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:23.311748 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-abc72440-1644-44fd-8d28-191b89c446dc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:23.313800 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-664e4e24-b74d-4ec9-bde4-d53bee6b36bf req-6dd69c17-b327-42bf-9b4f-759139a40b1c service nova] Creating event network-vif-plugged:bc2b2be5-4c28-489f-8bda-05bbb62b4e19 for instance 42e06cf4-bb49-4d51-93c1-3147069bd032 on hv-cinder-85331 Aug 17 08:43:23.318943 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-664e4e24-b74d-4ec9-bde4-d53bee6b36bf req-6dd69c17-b327-42bf-9b4f-759139a40b1c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034343 Aug 17 08:43:23.319896 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 281/560] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:43:23.452727 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-abc72440-1644-44fd-8d28-191b89c446dc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:23.461281 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-abc72440-1644-44fd-8d28-191b89c446dc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:23.463295 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-abc72440-1644-44fd-8d28-191b89c446dc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:23.464454 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-abc72440-1644-44fd-8d28-191b89c446dc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1405 microversion: 2.20 time: 0.172139 Aug 17 08:43:23.465004 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 280/561] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:43:23 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:43:24.236831 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4393cd3f-57d0-4f69-b062-da6659361cce tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:24.237600 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-4393cd3f-57d0-4f69-b062-da6659361cce tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:24.243925 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4393cd3f-57d0-4f69-b062-da6659361cce tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:24.245096 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4393cd3f-57d0-4f69-b062-da6659361cce tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:24.245614 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4393cd3f-57d0-4f69-b062-da6659361cce tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:24.246379 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4393cd3f-57d0-4f69-b062-da6659361cce tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:24.246894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4393cd3f-57d0-4f69-b062-da6659361cce tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:24.247317 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4393cd3f-57d0-4f69-b062-da6659361cce tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:24.374576 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-4393cd3f-57d0-4f69-b062-da6659361cce tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:24.382008 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4393cd3f-57d0-4f69-b062-da6659361cce tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1576 microversion: 2.1 time: 0.149880 Aug 17 08:43:24.382599 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 282/562] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:24 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:24.486447 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d33304d7-1846-46d4-bf89-f198c7fdc1ef tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:24.487039 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d33304d7-1846-46d4-bf89-f198c7fdc1ef tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:24.493472 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d33304d7-1846-46d4-bf89-f198c7fdc1ef tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:24.493940 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d33304d7-1846-46d4-bf89-f198c7fdc1ef tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:24.494870 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d33304d7-1846-46d4-bf89-f198c7fdc1ef tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:24.495534 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d33304d7-1846-46d4-bf89-f198c7fdc1ef tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:24.495992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d33304d7-1846-46d4-bf89-f198c7fdc1ef tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:24.496405 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d33304d7-1846-46d4-bf89-f198c7fdc1ef tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:24.627256 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-d33304d7-1846-46d4-bf89-f198c7fdc1ef tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:24.635084 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-d33304d7-1846-46d4-bf89-f198c7fdc1ef tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:24.636611 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-d33304d7-1846-46d4-bf89-f198c7fdc1ef tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:24.637729 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d33304d7-1846-46d4-bf89-f198c7fdc1ef tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1405 microversion: 2.20 time: 0.155162 Aug 17 08:43:24.638285 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 281/563] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:43:24 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:43:25.403980 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ac09e664-b191-4c49-b693-111827540efa tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:25.404580 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ac09e664-b191-4c49-b693-111827540efa tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:25.410805 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ac09e664-b191-4c49-b693-111827540efa tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:25.411296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ac09e664-b191-4c49-b693-111827540efa tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:25.411741 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ac09e664-b191-4c49-b693-111827540efa tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:25.412424 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ac09e664-b191-4c49-b693-111827540efa tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:25.412868 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ac09e664-b191-4c49-b693-111827540efa tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:25.413285 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ac09e664-b191-4c49-b693-111827540efa tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:25.543830 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ac09e664-b191-4c49-b693-111827540efa tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:25.551201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ac09e664-b191-4c49-b693-111827540efa tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1576 microversion: 2.1 time: 0.151759 Aug 17 08:43:25.551800 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 283/564] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:25 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:25.659908 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-46c49c1d-63b8-4e08-84e1-5536fbed2273 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:25.660507 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-46c49c1d-63b8-4e08-84e1-5536fbed2273 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:25.666922 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-46c49c1d-63b8-4e08-84e1-5536fbed2273 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:25.667398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-46c49c1d-63b8-4e08-84e1-5536fbed2273 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:25.667857 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-46c49c1d-63b8-4e08-84e1-5536fbed2273 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:25.668538 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-46c49c1d-63b8-4e08-84e1-5536fbed2273 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:25.668986 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-46c49c1d-63b8-4e08-84e1-5536fbed2273 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:25.669405 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-46c49c1d-63b8-4e08-84e1-5536fbed2273 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:25.799336 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-46c49c1d-63b8-4e08-84e1-5536fbed2273 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:25.807725 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-46c49c1d-63b8-4e08-84e1-5536fbed2273 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:25.809217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-46c49c1d-63b8-4e08-84e1-5536fbed2273 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:25.810373 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-46c49c1d-63b8-4e08-84e1-5536fbed2273 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1597 microversion: 2.20 time: 0.154287 Aug 17 08:43:25.810924 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 282/565] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:43:25 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1597 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:43:25.832746 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b95c33b0-598f-4101-8a68-0bc5e2cacdd3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:25.833229 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b95c33b0-598f-4101-8a68-0bc5e2cacdd3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:25.839230 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b95c33b0-598f-4101-8a68-0bc5e2cacdd3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:25.839837 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b95c33b0-598f-4101-8a68-0bc5e2cacdd3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:25.840295 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b95c33b0-598f-4101-8a68-0bc5e2cacdd3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:25.840972 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b95c33b0-598f-4101-8a68-0bc5e2cacdd3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:25.841411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b95c33b0-598f-4101-8a68-0bc5e2cacdd3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:25.841819 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b95c33b0-598f-4101-8a68-0bc5e2cacdd3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:25.915379 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b95c33b0-598f-4101-8a68-0bc5e2cacdd3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.086812 Aug 17 08:43:25.916004 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 284/566] 10.222.0.15 () {60 vars in 1316 bytes} [Wed Aug 17 08:43:25 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 08:43:26.572589 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c08a65f9-b6c9-4e3f-97de-85672279a3ff tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:26.573221 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c08a65f9-b6c9-4e3f-97de-85672279a3ff tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:26.575287 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:43:26.575975 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=10 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:43:26.582137 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c08a65f9-b6c9-4e3f-97de-85672279a3ff tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:26.582625 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c08a65f9-b6c9-4e3f-97de-85672279a3ff tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:26.583051 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c08a65f9-b6c9-4e3f-97de-85672279a3ff tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:26.583766 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c08a65f9-b6c9-4e3f-97de-85672279a3ff tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:26.584212 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c08a65f9-b6c9-4e3f-97de-85672279a3ff tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:26.584624 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c08a65f9-b6c9-4e3f-97de-85672279a3ff tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:26.720251 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c08a65f9-b6c9-4e3f-97de-85672279a3ff tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:26.727796 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c08a65f9-b6c9-4e3f-97de-85672279a3ff tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1576 microversion: 2.1 time: 0.158966 Aug 17 08:43:26.728960 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 283/567] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:26 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:27.018708 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:43:27.023255 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-5c41de00-8cf5-4335-8184-e49552235e6e req-e9af8a1c-56f8-46da-aaa8-4a228dadd9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42e06cf4-bb49-4d51-93c1-3147069bd032", "tag": "bc2b2be5-4c28-489f-8bda-05bbb62b4e19"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:43:27.033856 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-5c41de00-8cf5-4335-8184-e49552235e6e req-e9af8a1c-56f8-46da-aaa8-4a228dadd9b9 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:27.034338 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-5c41de00-8cf5-4335-8184-e49552235e6e req-e9af8a1c-56f8-46da-aaa8-4a228dadd9b9 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:27.034757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-5c41de00-8cf5-4335-8184-e49552235e6e req-e9af8a1c-56f8-46da-aaa8-4a228dadd9b9 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:27.045806 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-5c41de00-8cf5-4335-8184-e49552235e6e req-e9af8a1c-56f8-46da-aaa8-4a228dadd9b9 service nova] Creating event network-changed:bc2b2be5-4c28-489f-8bda-05bbb62b4e19 for instance 42e06cf4-bb49-4d51-93c1-3147069bd032 on hv-cinder-85331 Aug 17 08:43:27.050546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-5c41de00-8cf5-4335-8184-e49552235e6e req-e9af8a1c-56f8-46da-aaa8-4a228dadd9b9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032495 Aug 17 08:43:27.051136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 285/568] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:43:27.750931 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a8e4f9f9-a1b9-4441-ac02-ae6d4af9c7f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:27.751374 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a8e4f9f9-a1b9-4441-ac02-ae6d4af9c7f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:27.758143 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a8e4f9f9-a1b9-4441-ac02-ae6d4af9c7f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:27.758798 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a8e4f9f9-a1b9-4441-ac02-ae6d4af9c7f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:27.759232 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a8e4f9f9-a1b9-4441-ac02-ae6d4af9c7f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:27.759974 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a8e4f9f9-a1b9-4441-ac02-ae6d4af9c7f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:27.760425 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a8e4f9f9-a1b9-4441-ac02-ae6d4af9c7f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:27.760852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a8e4f9f9-a1b9-4441-ac02-ae6d4af9c7f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:27.903901 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a8e4f9f9-a1b9-4441-ac02-ae6d4af9c7f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:27.911595 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a8e4f9f9-a1b9-4441-ac02-ae6d4af9c7f7 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1576 microversion: 2.1 time: 0.164993 Aug 17 08:43:27.912265 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 284/569] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:27 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:28.934198 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-23dc8bd5-213a-4fcc-9701-057569cf9a4f tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:28.934893 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-23dc8bd5-213a-4fcc-9701-057569cf9a4f tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:28.941758 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-23dc8bd5-213a-4fcc-9701-057569cf9a4f tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:28.942197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-23dc8bd5-213a-4fcc-9701-057569cf9a4f tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:28.942622 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-23dc8bd5-213a-4fcc-9701-057569cf9a4f tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:28.943307 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-23dc8bd5-213a-4fcc-9701-057569cf9a4f tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:28.943804 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-23dc8bd5-213a-4fcc-9701-057569cf9a4f tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:28.944226 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-23dc8bd5-213a-4fcc-9701-057569cf9a4f tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:29.071977 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-23dc8bd5-213a-4fcc-9701-057569cf9a4f tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:29.080234 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-23dc8bd5-213a-4fcc-9701-057569cf9a4f tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1576 microversion: 2.1 time: 0.150862 Aug 17 08:43:29.080802 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 286/570] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:28 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:29.534188 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ca3df1a2-3cd3-443c-b5ed-4ff80fb4c9b2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:29.536495 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ca3df1a2-3cd3-443c-b5ed-4ff80fb4c9b2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:29.543641 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca3df1a2-3cd3-443c-b5ed-4ff80fb4c9b2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:29.544121 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca3df1a2-3cd3-443c-b5ed-4ff80fb4c9b2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:29.544548 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca3df1a2-3cd3-443c-b5ed-4ff80fb4c9b2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:29.545231 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca3df1a2-3cd3-443c-b5ed-4ff80fb4c9b2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:29.545679 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca3df1a2-3cd3-443c-b5ed-4ff80fb4c9b2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:29.546099 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ca3df1a2-3cd3-443c-b5ed-4ff80fb4c9b2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:29.574821 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ca3df1a2-3cd3-443c-b5ed-4ff80fb4c9b2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044467 Aug 17 08:43:29.575369 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 285/571] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 08:43:29 2022] GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:43:29.718413 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-dd47b975-c471-43f1-87be-693f58081254 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:29.718932 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-dd47b975-c471-43f1-87be-693f58081254 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:29.724843 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dd47b975-c471-43f1-87be-693f58081254 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:29.725326 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dd47b975-c471-43f1-87be-693f58081254 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:29.725754 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dd47b975-c471-43f1-87be-693f58081254 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:29.726434 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dd47b975-c471-43f1-87be-693f58081254 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:29.726879 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dd47b975-c471-43f1-87be-693f58081254 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:29.727290 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-dd47b975-c471-43f1-87be-693f58081254 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:29.757279 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-dd47b975-c471-43f1-87be-693f58081254 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/os-volume_attachments/ac4ef9c0-b592-4dd1-b7dd-cbaaeff68890" status: 200 len: 194 microversion: 2.1 time: 0.043040 Aug 17 08:43:29.758161 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 287/572] 10.222.0.15 () {58 vars in 1413 bytes} [Wed Aug 17 08:43:29 2022] GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/os-volume_attachments/ac4ef9c0-b592-4dd1-b7dd-cbaaeff68890 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:43:29.768254 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-28980888-7549-4c73-9d9a-97aea2d732c3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:29.768672 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-28980888-7549-4c73-9d9a-97aea2d732c3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:29.775800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-28980888-7549-4c73-9d9a-97aea2d732c3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:29.776653 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-28980888-7549-4c73-9d9a-97aea2d732c3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:29.777128 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-28980888-7549-4c73-9d9a-97aea2d732c3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:29.781775 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-28980888-7549-4c73-9d9a-97aea2d732c3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:29.782974 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-28980888-7549-4c73-9d9a-97aea2d732c3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:29.783709 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-28980888-7549-4c73-9d9a-97aea2d732c3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:29.867883 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-28980888-7549-4c73-9d9a-97aea2d732c3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lazy-loading 'services' on Instance uuid 2079306f-d3fe-4fee-87fd-02bc595e53e2 {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:43:29.937305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-28980888-7549-4c73-9d9a-97aea2d732c3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/os-volume_attachments/ac4ef9c0-b592-4dd1-b7dd-cbaaeff68890" status: 202 len: 0 microversion: 2.1 time: 0.172848 Aug 17 08:43:29.937910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 286/573] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 08:43:29 2022] DELETE /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/os-volume_attachments/ac4ef9c0-b592-4dd1-b7dd-cbaaeff68890 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:43:30.100846 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6bbb7576-51e8-4bde-8fc0-adbb4d066fc4 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:30.101444 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6bbb7576-51e8-4bde-8fc0-adbb4d066fc4 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:30.107757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6bbb7576-51e8-4bde-8fc0-adbb4d066fc4 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:30.108228 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6bbb7576-51e8-4bde-8fc0-adbb4d066fc4 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:30.108653 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6bbb7576-51e8-4bde-8fc0-adbb4d066fc4 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:30.109325 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6bbb7576-51e8-4bde-8fc0-adbb4d066fc4 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:30.109765 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6bbb7576-51e8-4bde-8fc0-adbb4d066fc4 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:30.110178 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6bbb7576-51e8-4bde-8fc0-adbb4d066fc4 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:30.243354 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6bbb7576-51e8-4bde-8fc0-adbb4d066fc4 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:30.251279 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6bbb7576-51e8-4bde-8fc0-adbb4d066fc4 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1576 microversion: 2.1 time: 0.154193 Aug 17 08:43:30.251879 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 288/574] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:30 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:31.054280 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1adfca06-ff72-414c-9df5-b907f45e4db2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:31.054962 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1adfca06-ff72-414c-9df5-b907f45e4db2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:31.063396 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1adfca06-ff72-414c-9df5-b907f45e4db2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:31.063899 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1adfca06-ff72-414c-9df5-b907f45e4db2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:31.064325 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1adfca06-ff72-414c-9df5-b907f45e4db2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:31.065008 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1adfca06-ff72-414c-9df5-b907f45e4db2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:31.065447 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1adfca06-ff72-414c-9df5-b907f45e4db2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:31.065860 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1adfca06-ff72-414c-9df5-b907f45e4db2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:31.095212 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1adfca06-ff72-414c-9df5-b907f45e4db2 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/os-volume_attachments/845806db-f208-4932-a4af-8e63bc001ab9" status: 200 len: 194 microversion: 2.1 time: 0.045960 Aug 17 08:43:31.095824 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 287/575] 10.222.0.15 () {58 vars in 1413 bytes} [Wed Aug 17 08:43:31 2022] GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/os-volume_attachments/845806db-f208-4932-a4af-8e63bc001ab9 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:43:31.106707 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d28a1428-5dcd-4bea-a6d1-2570d0fc1d5b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:31.107189 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d28a1428-5dcd-4bea-a6d1-2570d0fc1d5b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:31.113554 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d28a1428-5dcd-4bea-a6d1-2570d0fc1d5b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:31.114005 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d28a1428-5dcd-4bea-a6d1-2570d0fc1d5b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:31.114428 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d28a1428-5dcd-4bea-a6d1-2570d0fc1d5b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:31.115096 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d28a1428-5dcd-4bea-a6d1-2570d0fc1d5b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:31.115643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d28a1428-5dcd-4bea-a6d1-2570d0fc1d5b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:31.115980 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d28a1428-5dcd-4bea-a6d1-2570d0fc1d5b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:31.194934 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.objects.instance [None req-d28a1428-5dcd-4bea-a6d1-2570d0fc1d5b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lazy-loading 'services' on Instance uuid 2079306f-d3fe-4fee-87fd-02bc595e53e2 {{(pid=127297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:43:31.272551 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-de7baf8e-d5db-4255-9d69-c27607a154fc tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:31.273157 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-de7baf8e-d5db-4255-9d69-c27607a154fc tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:31.279785 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-de7baf8e-d5db-4255-9d69-c27607a154fc tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:31.280274 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-de7baf8e-d5db-4255-9d69-c27607a154fc tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:31.280704 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-de7baf8e-d5db-4255-9d69-c27607a154fc tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:31.281394 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-de7baf8e-d5db-4255-9d69-c27607a154fc tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:31.281840 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-de7baf8e-d5db-4255-9d69-c27607a154fc tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:31.282450 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-de7baf8e-d5db-4255-9d69-c27607a154fc tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:31.320766 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d28a1428-5dcd-4bea-a6d1-2570d0fc1d5b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/os-volume_attachments/845806db-f208-4932-a4af-8e63bc001ab9" status: 202 len: 0 microversion: 2.1 time: 0.218401 Aug 17 08:43:31.321572 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 289/576] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 08:43:31 2022] DELETE /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/os-volume_attachments/845806db-f208-4932-a4af-8e63bc001ab9 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:43:31.442531 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-de7baf8e-d5db-4255-9d69-c27607a154fc tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:31.446061 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:43:31.451700 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-de7baf8e-d5db-4255-9d69-c27607a154fc tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1576 microversion: 2.1 time: 0.182917 Aug 17 08:43:31.452265 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 288/577] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:31 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:43:31.537769 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-57afaa83-5c9c-448c-8988-95619e5e9a5b req-0d7311e2-5c98-40f7-84c2-48b02c7c82f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe1b2a32-cde6-43da-885e-78a42a55a7f1", "name": "network-vif-plugged", "status": "completed", "tag": "26fa0a6d-8a86-40e7-a48f-d1b7d96cfcfb"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:43:31.548120 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-57afaa83-5c9c-448c-8988-95619e5e9a5b req-0d7311e2-5c98-40f7-84c2-48b02c7c82f4 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:31.548592 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-57afaa83-5c9c-448c-8988-95619e5e9a5b req-0d7311e2-5c98-40f7-84c2-48b02c7c82f4 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:31.549007 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-57afaa83-5c9c-448c-8988-95619e5e9a5b req-0d7311e2-5c98-40f7-84c2-48b02c7c82f4 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:31.559426 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-57afaa83-5c9c-448c-8988-95619e5e9a5b req-0d7311e2-5c98-40f7-84c2-48b02c7c82f4 service nova] Creating event network-vif-plugged:26fa0a6d-8a86-40e7-a48f-d1b7d96cfcfb for instance fe1b2a32-cde6-43da-885e-78a42a55a7f1 on hv-cinder-85331 Aug 17 08:43:31.564166 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-57afaa83-5c9c-448c-8988-95619e5e9a5b req-0d7311e2-5c98-40f7-84c2-48b02c7c82f4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089546 Aug 17 08:43:31.564729 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 290/578] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:43:32.474740 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-11a7f61a-8bcb-4664-8ad3-da44cd486720 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:32.475344 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-11a7f61a-8bcb-4664-8ad3-da44cd486720 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:32.482694 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-11a7f61a-8bcb-4664-8ad3-da44cd486720 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:32.483171 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-11a7f61a-8bcb-4664-8ad3-da44cd486720 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:32.483630 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-11a7f61a-8bcb-4664-8ad3-da44cd486720 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:32.484317 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-11a7f61a-8bcb-4664-8ad3-da44cd486720 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:32.484762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-11a7f61a-8bcb-4664-8ad3-da44cd486720 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:32.485176 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-11a7f61a-8bcb-4664-8ad3-da44cd486720 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:32.509318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2e7f709c-68e5-4d35-932b-bbc3f138e80b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:32.511556 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-2e7f709c-68e5-4d35-932b-bbc3f138e80b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:32.517653 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2e7f709c-68e5-4d35-932b-bbc3f138e80b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:32.518134 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2e7f709c-68e5-4d35-932b-bbc3f138e80b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:32.518570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2e7f709c-68e5-4d35-932b-bbc3f138e80b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:32.519262 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2e7f709c-68e5-4d35-932b-bbc3f138e80b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:32.519746 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2e7f709c-68e5-4d35-932b-bbc3f138e80b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:32.520169 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2e7f709c-68e5-4d35-932b-bbc3f138e80b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:32.550800 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2e7f709c-68e5-4d35-932b-bbc3f138e80b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046166 Aug 17 08:43:32.551372 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 291/579] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 08:43:32 2022] GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 17 08:43:32.627176 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-11a7f61a-8bcb-4664-8ad3-da44cd486720 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:32.634772 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-11a7f61a-8bcb-4664-8ad3-da44cd486720 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1576 microversion: 2.1 time: 0.164392 Aug 17 08:43:32.635417 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 289/580] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:32 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:32.674586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-52685d8d-81b5-48ee-8273-5921e92114f1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:32.676822 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-52685d8d-81b5-48ee-8273-5921e92114f1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:32.682688 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-52685d8d-81b5-48ee-8273-5921e92114f1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:32.683168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-52685d8d-81b5-48ee-8273-5921e92114f1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:32.683630 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-52685d8d-81b5-48ee-8273-5921e92114f1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:32.684314 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-52685d8d-81b5-48ee-8273-5921e92114f1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:32.684762 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-52685d8d-81b5-48ee-8273-5921e92114f1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:32.685181 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-52685d8d-81b5-48ee-8273-5921e92114f1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:32.713557 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-52685d8d-81b5-48ee-8273-5921e92114f1 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042813 Aug 17 08:43:32.714105 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 292/581] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 08:43:32 2022] GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 08:43:32.775736 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d88695b7-75ea-41cd-b9c1-d336652a6b5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:32.776224 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d88695b7-75ea-41cd-b9c1-d336652a6b5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:32.782000 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d88695b7-75ea-41cd-b9c1-d336652a6b5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:32.782478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d88695b7-75ea-41cd-b9c1-d336652a6b5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:32.782907 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d88695b7-75ea-41cd-b9c1-d336652a6b5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:32.783603 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d88695b7-75ea-41cd-b9c1-d336652a6b5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:32.784053 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d88695b7-75ea-41cd-b9c1-d336652a6b5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:32.784467 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d88695b7-75ea-41cd-b9c1-d336652a6b5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:32.808494 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d88695b7-75ea-41cd-b9c1-d336652a6b5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 08:43:32.880510 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d88695b7-75ea-41cd-b9c1-d336652a6b5d tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2" status: 204 len: 0 microversion: 2.1 time: 0.108828 Aug 17 08:43:32.881267 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 290/582] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:43:32 2022] DELETE /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 08:43:32.889713 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3002a187-ecc0-4785-a8de-16f467b6d724 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:32.890375 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3002a187-ecc0-4785-a8de-16f467b6d724 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:32.896205 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3002a187-ecc0-4785-a8de-16f467b6d724 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:32.896686 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3002a187-ecc0-4785-a8de-16f467b6d724 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:32.897120 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3002a187-ecc0-4785-a8de-16f467b6d724 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:32.897800 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3002a187-ecc0-4785-a8de-16f467b6d724 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:32.898247 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3002a187-ecc0-4785-a8de-16f467b6d724 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:32.898669 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3002a187-ecc0-4785-a8de-16f467b6d724 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:33.031418 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3002a187-ecc0-4785-a8de-16f467b6d724 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:33.038896 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3002a187-ecc0-4785-a8de-16f467b6d724 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2" status: 200 len: 1672 microversion: 2.1 time: 0.152949 Aug 17 08:43:33.039460 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 293/583] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:32 2022] GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:33.656264 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c58e6898-4e2e-4deb-a469-9701c6587efe tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:33.656949 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c58e6898-4e2e-4deb-a469-9701c6587efe tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:33.663258 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c58e6898-4e2e-4deb-a469-9701c6587efe tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:33.663760 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c58e6898-4e2e-4deb-a469-9701c6587efe tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:33.664186 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c58e6898-4e2e-4deb-a469-9701c6587efe tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:33.664848 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c58e6898-4e2e-4deb-a469-9701c6587efe tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:33.665290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c58e6898-4e2e-4deb-a469-9701c6587efe tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:33.666209 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c58e6898-4e2e-4deb-a469-9701c6587efe tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:33.796453 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c58e6898-4e2e-4deb-a469-9701c6587efe tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:33.803902 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c58e6898-4e2e-4deb-a469-9701c6587efe tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1576 microversion: 2.1 time: 0.151834 Aug 17 08:43:33.804460 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 291/584] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:33 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:34.059463 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-89b6199c-62f4-4bda-a48c-a700e0e194d8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:34.060144 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-89b6199c-62f4-4bda-a48c-a700e0e194d8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:34.066480 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-89b6199c-62f4-4bda-a48c-a700e0e194d8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:34.066958 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-89b6199c-62f4-4bda-a48c-a700e0e194d8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:34.067389 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-89b6199c-62f4-4bda-a48c-a700e0e194d8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:34.068121 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-89b6199c-62f4-4bda-a48c-a700e0e194d8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:34.068570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-89b6199c-62f4-4bda-a48c-a700e0e194d8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:34.068989 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-89b6199c-62f4-4bda-a48c-a700e0e194d8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:34.194272 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-89b6199c-62f4-4bda-a48c-a700e0e194d8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:34.201651 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-89b6199c-62f4-4bda-a48c-a700e0e194d8 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2" status: 200 len: 1672 microversion: 2.1 time: 0.146041 Aug 17 08:43:34.202210 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 294/585] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:34 2022] GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2 => generated 1672 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:34.824991 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-4f518f29-b893-4509-8fe4-406034665a8c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:34.825510 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-4f518f29-b893-4509-8fe4-406034665a8c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:34.832230 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4f518f29-b893-4509-8fe4-406034665a8c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:34.832699 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4f518f29-b893-4509-8fe4-406034665a8c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:34.833126 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4f518f29-b893-4509-8fe4-406034665a8c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:34.833925 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4f518f29-b893-4509-8fe4-406034665a8c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:34.834367 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4f518f29-b893-4509-8fe4-406034665a8c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:34.834848 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4f518f29-b893-4509-8fe4-406034665a8c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:34.965409 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-4f518f29-b893-4509-8fe4-406034665a8c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:34.972768 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-4f518f29-b893-4509-8fe4-406034665a8c tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1563 microversion: 2.1 time: 0.151839 Aug 17 08:43:34.973321 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 292/586] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:34 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:35.223650 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b9e9f9a6-ae07-4ea4-b6e2-c69b3bea040b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:35.224256 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b9e9f9a6-ae07-4ea4-b6e2-c69b3bea040b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:35.230541 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b9e9f9a6-ae07-4ea4-b6e2-c69b3bea040b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:35.231022 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b9e9f9a6-ae07-4ea4-b6e2-c69b3bea040b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:35.231460 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b9e9f9a6-ae07-4ea4-b6e2-c69b3bea040b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:35.232171 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b9e9f9a6-ae07-4ea4-b6e2-c69b3bea040b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:35.232630 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b9e9f9a6-ae07-4ea4-b6e2-c69b3bea040b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:35.233051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b9e9f9a6-ae07-4ea4-b6e2-c69b3bea040b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:35.456631 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b9e9f9a6-ae07-4ea4-b6e2-c69b3bea040b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:35.458956 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:43:35.466718 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b9e9f9a6-ae07-4ea4-b6e2-c69b3bea040b tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2" status: 200 len: 1672 microversion: 2.1 time: 0.246903 Aug 17 08:43:35.467329 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 295/587] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:35 2022] GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2 => generated 1672 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:36.039116 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-e27c307d-1bb0-47dc-8b8b-a470be8de7fa req-c6b87af2-a4ac-4d33-b645-90c989845569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2079306f-d3fe-4fee-87fd-02bc595e53e2", "name": "network-vif-deleted", "tag": "c4513763-19f1-4fff-a99c-27f312f66f82"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:43:36.050347 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-e27c307d-1bb0-47dc-8b8b-a470be8de7fa req-c6b87af2-a4ac-4d33-b645-90c989845569 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:36.050814 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-e27c307d-1bb0-47dc-8b8b-a470be8de7fa req-c6b87af2-a4ac-4d33-b645-90c989845569 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:36.051246 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-e27c307d-1bb0-47dc-8b8b-a470be8de7fa req-c6b87af2-a4ac-4d33-b645-90c989845569 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:36.063830 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-e27c307d-1bb0-47dc-8b8b-a470be8de7fa req-c6b87af2-a4ac-4d33-b645-90c989845569 service nova] Creating event network-vif-deleted:c4513763-19f1-4fff-a99c-27f312f66f82 for instance 2079306f-d3fe-4fee-87fd-02bc595e53e2 on hv-cinder-85331 Aug 17 08:43:36.069409 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-e27c307d-1bb0-47dc-8b8b-a470be8de7fa req-c6b87af2-a4ac-4d33-b645-90c989845569 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033839 Aug 17 08:43:36.070009 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 293/588] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:43:36.487700 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-9d1992d7-d03c-4ff3-8cf0-a83c450c2892 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:36.488292 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-9d1992d7-d03c-4ff3-8cf0-a83c450c2892 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:36.495696 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d1992d7-d03c-4ff3-8cf0-a83c450c2892 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:36.496242 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d1992d7-d03c-4ff3-8cf0-a83c450c2892 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:36.496861 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d1992d7-d03c-4ff3-8cf0-a83c450c2892 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:36.498317 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d1992d7-d03c-4ff3-8cf0-a83c450c2892 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:36.498906 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d1992d7-d03c-4ff3-8cf0-a83c450c2892 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:36.499238 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d1992d7-d03c-4ff3-8cf0-a83c450c2892 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:36.532257 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d1992d7-d03c-4ff3-8cf0-a83c450c2892 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:36.532869 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d1992d7-d03c-4ff3-8cf0-a83c450c2892 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:36.533333 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d1992d7-d03c-4ff3-8cf0-a83c450c2892 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:36.533962 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.objects.instance [None req-9d1992d7-d03c-4ff3-8cf0-a83c450c2892 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lazy-loading 'fault' on Instance uuid 2079306f-d3fe-4fee-87fd-02bc595e53e2 {{(pid=127297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:43:36.579406 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-9d1992d7-d03c-4ff3-8cf0-a83c450c2892 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aea5553e1043889571c50c3b01cacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458a894213fa47d78568eefbb75f05b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:36.587236 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-9d1992d7-d03c-4ff3-8cf0-a83c450c2892 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2" status: 200 len: 1327 microversion: 2.1 time: 0.103646 Aug 17 08:43:36.587857 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 296/589] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:36 2022] GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2 => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:37.610213 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d36d04d7-edd6-429e-8f7b-1e29af5a639e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:37.610931 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d36d04d7-edd6-429e-8f7b-1e29af5a639e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:37.617039 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d36d04d7-edd6-429e-8f7b-1e29af5a639e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:37.617516 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d36d04d7-edd6-429e-8f7b-1e29af5a639e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:37.617952 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d36d04d7-edd6-429e-8f7b-1e29af5a639e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:37.618778 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d36d04d7-edd6-429e-8f7b-1e29af5a639e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:37.619227 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d36d04d7-edd6-429e-8f7b-1e29af5a639e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:37.619676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d36d04d7-edd6-429e-8f7b-1e29af5a639e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:37.632572 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-d36d04d7-edd6-429e-8f7b-1e29af5a639e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] HTTP exception thrown: Instance 2079306f-d3fe-4fee-87fd-02bc595e53e2 could not be found. Aug 17 08:43:37.634633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d36d04d7-edd6-429e-8f7b-1e29af5a639e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Request method failure captured: Aug 17 08:43:37.634633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2 HTTP/1.1 Aug 17 08:43:37.634633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:43:37.634633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:43:37.634633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:43:37.634633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:43:37.634633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:43:37.634633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:43:37.634633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:43:37.634633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:43:37.634633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_KjiKWJZjWgNbqmM28Vjeu9R6ZeIg5FUJHEdYYZsokkrIlIQwAPOg76kV16_SM9dgrm4x4Ey7Bv5JK8yPNlJwFgI2TgzaNGCXIKf-RoVGXcv-LXAgcfo4Z6IqpCOKy8uSUOrF5FFN1LyukP3O_Z1I_aP4J27HRvibpbPvmhWPu10h-k Aug 17 08:43:37.634633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:43:37.634633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:43:37.634633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:43:37.634633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:43:37.634633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:43:37.634633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:43:37.634633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: 458a894213fa47d78568eefbb75f05b3 Aug 17 08:43:37.634633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeTestJSON-2031567907 Aug 17 08:43:37.634633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:43:37.634633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:43:37.636277 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/458a894213fa47d78568eefbb75f05b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/458a894213fa47d78568eefbb75f05b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/458a894213fa47d78568eefbb75f05b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_458a894213fa47d78568eefbb75f05b3", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:43:37.636277 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeTestJSON-2031567907 Aug 17 08:43:37.636277 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 458a894213fa47d78568eefbb75f05b3 Aug 17 08:43:37.636277 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2031567907 Aug 17 08:43:37.636277 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeTestJSON-2031567907-project Aug 17 08:43:37.636277 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:43:37.636277 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:43:37.636277 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: d0aea5553e1043889571c50c3b01cacc Aug 17 08:43:37.636277 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeTestJSON-2031567907-project Aug 17 08:43:37.636277 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:43:37.636277 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Instance 2079306f-d3fe-4fee-87fd-02bc595e53e2 could not be found. Aug 17 08:43:37.636277 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'id': '2079306f-d3fe-4fee-87fd-02bc595e53e2'} Aug 17 08:43:37.637398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:43:37.637398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:43:37.637398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:43:37.637398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:43:37.637398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:43:37.637398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:43:37.637398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:43:37.637398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:43:37.637398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:43:37.637398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:43:37.637398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2079306f-d3fe-4fee-87fd-02bc595e53e2 could not be found. Aug 17 08:43:37.637398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:43:37.637398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:43:37.637398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:43:37.637398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:43:37.637398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:43:37.637398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:43:37.637398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:43:37.637398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:43:37.637398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:43:37.639017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:43:37.639017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:43:37.639017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:43:37.639017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:43:37.639017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:43:37.639017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:43:37.639017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:43:37.639017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2079306f-d3fe-4fee-87fd-02bc595e53e2 could not be found. Aug 17 08:43:37.639017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:43:37.639017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:43:37.639017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:43:37.639017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:43:37.639017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:43:37.639017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:43:37.639017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:43:37.639017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:43:37.639017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2079306f-d3fe-4fee-87fd-02bc595e53e2 could not be found. Aug 17 08:43:37.639017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:43:37.640667 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d36d04d7-edd6-429e-8f7b-1e29af5a639e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Returning 404 to user: Instance 2079306f-d3fe-4fee-87fd-02bc595e53e2 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:43:37.640667 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d36d04d7-edd6-429e-8f7b-1e29af5a639e tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2" status: 404 len: 111 microversion: 2.1 time: 0.030618 Aug 17 08:43:37.640667 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 294/590] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:37 2022] GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:43:37.644630 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-897afe28-8ce5-4bc3-a46d-4940cce28d75 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '.version_select at 0x7f3f85450160>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:37.663389 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-897afe28-8ce5-4bc3-a46d-4940cce28d75 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320256942" status: 202 len: 0 microversion: 2.1 time: 0.022487 Aug 17 08:43:37.663994 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 297/591] 10.222.0.15 () {58 vars in 1221 bytes} [Wed Aug 17 08:43:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320256942 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:43:40.519913 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b69a7e1b-e19b-4f0b-b571-b741d5be27fe tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:40.520408 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b69a7e1b-e19b-4f0b-b571-b741d5be27fe tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:40.526893 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b69a7e1b-e19b-4f0b-b571-b741d5be27fe tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:40.527366 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b69a7e1b-e19b-4f0b-b571-b741d5be27fe tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:40.527837 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b69a7e1b-e19b-4f0b-b571-b741d5be27fe tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:40.528509 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b69a7e1b-e19b-4f0b-b571-b741d5be27fe tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:40.528948 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b69a7e1b-e19b-4f0b-b571-b741d5be27fe tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:40.529361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b69a7e1b-e19b-4f0b-b571-b741d5be27fe tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:40.543282 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-b69a7e1b-e19b-4f0b-b571-b741d5be27fe tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] HTTP exception thrown: Instance 2079306f-d3fe-4fee-87fd-02bc595e53e2 could not be found. Aug 17 08:43:40.545137 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b69a7e1b-e19b-4f0b-b571-b741d5be27fe tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Request method failure captured: Aug 17 08:43:40.545137 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: DELETE /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2 HTTP/1.1 Aug 17 08:43:40.545137 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:43:40.545137 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:43:40.545137 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:43:40.545137 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:43:40.545137 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:43:40.545137 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:43:40.545137 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:43:40.545137 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:43:40.545137 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_KjiKWJZjWgNbqmM28Vjeu9R6ZeIg5FUJHEdYYZsokkrIlIQwAPOg76kV16_SM9dgrm4x4Ey7Bv5JK8yPNlJwFgI2TgzaNGCXIKf-RoVGXcv-LXAgcfo4Z6IqpCOKy8uSUOrF5FFN1LyukP3O_Z1I_aP4J27HRvibpbPvmhWPu10h-k Aug 17 08:43:40.545137 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:43:40.545137 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:43:40.545137 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:43:40.545137 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:43:40.545137 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:43:40.545137 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:43:40.545137 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: 458a894213fa47d78568eefbb75f05b3 Aug 17 08:43:40.545137 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeTestJSON-2031567907 Aug 17 08:43:40.545137 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:43:40.545137 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:43:40.546746 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/458a894213fa47d78568eefbb75f05b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/458a894213fa47d78568eefbb75f05b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/458a894213fa47d78568eefbb75f05b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_458a894213fa47d78568eefbb75f05b3", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:43:40.546746 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeTestJSON-2031567907 Aug 17 08:43:40.546746 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 458a894213fa47d78568eefbb75f05b3 Aug 17 08:43:40.546746 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2031567907 Aug 17 08:43:40.546746 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeTestJSON-2031567907-project Aug 17 08:43:40.546746 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:43:40.546746 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:43:40.546746 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: d0aea5553e1043889571c50c3b01cacc Aug 17 08:43:40.546746 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeTestJSON-2031567907-project Aug 17 08:43:40.546746 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:43:40.546746 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Instance 2079306f-d3fe-4fee-87fd-02bc595e53e2 could not be found. Aug 17 08:43:40.546746 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'id': '2079306f-d3fe-4fee-87fd-02bc595e53e2'} Aug 17 08:43:40.547676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:43:40.547676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:43:40.547676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:43:40.547676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:43:40.547676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:43:40.547676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:43:40.547676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:43:40.547676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:43:40.547676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:43:40.547676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:43:40.547676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2079306f-d3fe-4fee-87fd-02bc595e53e2 could not be found. Aug 17 08:43:40.547676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:43:40.547676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:43:40.547676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:43:40.547676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:43:40.547676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:43:40.547676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:43:40.547676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:43:40.547676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:43:40.547676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:43:40.549067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:43:40.549067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 08:43:40.549067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 08:43:40.549067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 08:43:40.549067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 08:43:40.549067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:43:40.549067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:43:40.549067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:43:40.549067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:43:40.549067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2079306f-d3fe-4fee-87fd-02bc595e53e2 could not be found. Aug 17 08:43:40.549067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:43:40.549067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:43:40.549067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:43:40.549067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:43:40.549067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:43:40.549067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:43:40.549067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:43:40.549067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:43:40.549067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2079306f-d3fe-4fee-87fd-02bc595e53e2 could not be found. Aug 17 08:43:40.549067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:43:40.550259 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b69a7e1b-e19b-4f0b-b571-b741d5be27fe tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Returning 404 to user: Instance 2079306f-d3fe-4fee-87fd-02bc595e53e2 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:43:40.550259 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b69a7e1b-e19b-4f0b-b571-b741d5be27fe tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2" status: 404 len: 111 microversion: 2.1 time: 0.030419 Aug 17 08:43:40.550259 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 295/592] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:43:40 2022] DELETE /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:43:40.555608 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-cdc1b542-810f-4943-8c39-e79507d71781 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:40.556257 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-cdc1b542-810f-4943-8c39-e79507d71781 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: 2079306f-d3fe-4fee-87fd-02bc595e53e2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:40.563382 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cdc1b542-810f-4943-8c39-e79507d71781 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:40.563887 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cdc1b542-810f-4943-8c39-e79507d71781 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:40.564351 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cdc1b542-810f-4943-8c39-e79507d71781 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:40.565032 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cdc1b542-810f-4943-8c39-e79507d71781 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:40.565490 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cdc1b542-810f-4943-8c39-e79507d71781 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:40.565917 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cdc1b542-810f-4943-8c39-e79507d71781 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:40.578948 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-cdc1b542-810f-4943-8c39-e79507d71781 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] HTTP exception thrown: Instance 2079306f-d3fe-4fee-87fd-02bc595e53e2 could not be found. Aug 17 08:43:40.580586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-cdc1b542-810f-4943-8c39-e79507d71781 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Request method failure captured: Aug 17 08:43:40.580586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2 HTTP/1.1 Aug 17 08:43:40.580586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:43:40.580586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:43:40.580586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:43:40.580586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:43:40.580586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:43:40.580586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:43:40.580586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:43:40.580586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:43:40.580586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_KjiKWJZjWgNbqmM28Vjeu9R6ZeIg5FUJHEdYYZsokkrIlIQwAPOg76kV16_SM9dgrm4x4Ey7Bv5JK8yPNlJwFgI2TgzaNGCXIKf-RoVGXcv-LXAgcfo4Z6IqpCOKy8uSUOrF5FFN1LyukP3O_Z1I_aP4J27HRvibpbPvmhWPu10h-k Aug 17 08:43:40.580586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:43:40.580586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:43:40.580586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:43:40.580586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:43:40.580586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:43:40.580586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:43:40.580586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: 458a894213fa47d78568eefbb75f05b3 Aug 17 08:43:40.580586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-AttachVolumeTestJSON-2031567907 Aug 17 08:43:40.580586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:43:40.580586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:43:40.582175 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/458a894213fa47d78568eefbb75f05b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/458a894213fa47d78568eefbb75f05b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/458a894213fa47d78568eefbb75f05b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_458a894213fa47d78568eefbb75f05b3", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:43:40.582175 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-AttachVolumeTestJSON-2031567907 Aug 17 08:43:40.582175 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 458a894213fa47d78568eefbb75f05b3 Aug 17 08:43:40.582175 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2031567907 Aug 17 08:43:40.582175 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-AttachVolumeTestJSON-2031567907-project Aug 17 08:43:40.582175 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:43:40.582175 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:43:40.582175 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: d0aea5553e1043889571c50c3b01cacc Aug 17 08:43:40.582175 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-AttachVolumeTestJSON-2031567907-project Aug 17 08:43:40.582175 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: > Aug 17 08:43:40.582175 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Instance 2079306f-d3fe-4fee-87fd-02bc595e53e2 could not be found. Aug 17 08:43:40.582175 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': '2079306f-d3fe-4fee-87fd-02bc595e53e2'} Aug 17 08:43:40.583066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:43:40.583066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:43:40.583066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:43:40.583066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:43:40.583066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:43:40.583066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:43:40.583066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:43:40.583066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:43:40.583066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:43:40.583066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:43:40.583066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2079306f-d3fe-4fee-87fd-02bc595e53e2 could not be found. Aug 17 08:43:40.583066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:43:40.583066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:43:40.583066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:43:40.583066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:43:40.583066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:43:40.583066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:43:40.583066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:43:40.583066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:43:40.583066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:43:40.584411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:43:40.584411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:43:40.584411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:43:40.584411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:43:40.584411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:43:40.584411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:43:40.584411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:43:40.584411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2079306f-d3fe-4fee-87fd-02bc595e53e2 could not be found. Aug 17 08:43:40.584411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:43:40.584411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:43:40.584411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:43:40.584411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:43:40.584411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:43:40.584411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:43:40.584411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:43:40.584411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:43:40.584411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2079306f-d3fe-4fee-87fd-02bc595e53e2 could not be found. Aug 17 08:43:40.584411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:43:40.585548 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-cdc1b542-810f-4943-8c39-e79507d71781 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Returning 404 to user: Instance 2079306f-d3fe-4fee-87fd-02bc595e53e2 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:43:40.585548 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-cdc1b542-810f-4943-8c39-e79507d71781 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2" status: 404 len: 111 microversion: 2.1 time: 0.030828 Aug 17 08:43:40.585548 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 298/593] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:40 2022] GET /compute/v2.1/servers/2079306f-d3fe-4fee-87fd-02bc595e53e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 08:43:41.722388 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c3dfc2eb-74f6-4855-9d7b-2f4a1cc366e3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:41.722866 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c3dfc2eb-74f6-4855-9d7b-2f4a1cc366e3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:41.729128 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c3dfc2eb-74f6-4855-9d7b-2f4a1cc366e3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:41.729627 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c3dfc2eb-74f6-4855-9d7b-2f4a1cc366e3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:41.730056 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c3dfc2eb-74f6-4855-9d7b-2f4a1cc366e3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:41.730726 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c3dfc2eb-74f6-4855-9d7b-2f4a1cc366e3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:41.731876 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c3dfc2eb-74f6-4855-9d7b-2f4a1cc366e3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:41.732287 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c3dfc2eb-74f6-4855-9d7b-2f4a1cc366e3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:41.747239 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-c3dfc2eb-74f6-4855-9d7b-2f4a1cc366e3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] HTTP exception thrown: Instance c224c091-7aa6-49a0-b269-a833010f6cc9 could not be found. Aug 17 08:43:41.748762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c3dfc2eb-74f6-4855-9d7b-2f4a1cc366e3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Request method failure captured: Aug 17 08:43:41.748762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: DELETE /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 HTTP/1.1 Aug 17 08:43:41.748762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:43:41.748762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:43:41.748762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:43:41.748762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:43:41.748762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:43:41.748762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:43:41.748762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:43:41.748762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:43:41.748762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_KjiKWJZjWgNbqmM28Vjeu9R6ZeIg5FUJHEdYYZsokkrIlIQwAPOg76kV16_SM9dgrm4x4Ey7Bv5JK8yPNlJwFgI2TgzaNGCXIKf-RoVGXcv-LXAgcfo4Z6IqpCOKy8uSUOrF5FFN1LyukP3O_Z1I_aP4J27HRvibpbPvmhWPu10h-k Aug 17 08:43:41.748762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:43:41.748762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:43:41.748762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:43:41.748762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:43:41.748762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:43:41.748762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:43:41.748762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: 458a894213fa47d78568eefbb75f05b3 Aug 17 08:43:41.748762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeTestJSON-2031567907 Aug 17 08:43:41.748762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:43:41.748762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:43:41.750322 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/458a894213fa47d78568eefbb75f05b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/458a894213fa47d78568eefbb75f05b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/458a894213fa47d78568eefbb75f05b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_458a894213fa47d78568eefbb75f05b3", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:43:41.750322 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeTestJSON-2031567907 Aug 17 08:43:41.750322 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 458a894213fa47d78568eefbb75f05b3 Aug 17 08:43:41.750322 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2031567907 Aug 17 08:43:41.750322 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeTestJSON-2031567907-project Aug 17 08:43:41.750322 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:43:41.750322 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:43:41.750322 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: d0aea5553e1043889571c50c3b01cacc Aug 17 08:43:41.750322 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeTestJSON-2031567907-project Aug 17 08:43:41.750322 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:43:41.750322 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Instance c224c091-7aa6-49a0-b269-a833010f6cc9 could not be found. Aug 17 08:43:41.750322 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'id': 'c224c091-7aa6-49a0-b269-a833010f6cc9'} Aug 17 08:43:41.751368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:43:41.751368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:43:41.751368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:43:41.751368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:43:41.751368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:43:41.751368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:43:41.751368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:43:41.751368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:43:41.751368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:43:41.751368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:43:41.751368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c224c091-7aa6-49a0-b269-a833010f6cc9 could not be found. Aug 17 08:43:41.751368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:43:41.751368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:43:41.751368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:43:41.751368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:43:41.751368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:43:41.751368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:43:41.751368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:43:41.751368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:43:41.751368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:43:41.752992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:43:41.752992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 08:43:41.752992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 08:43:41.752992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 08:43:41.752992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 08:43:41.752992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:43:41.752992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:43:41.752992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:43:41.752992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:43:41.752992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c224c091-7aa6-49a0-b269-a833010f6cc9 could not be found. Aug 17 08:43:41.752992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:43:41.752992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:43:41.752992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:43:41.752992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:43:41.752992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:43:41.752992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:43:41.752992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:43:41.752992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:43:41.752992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c224c091-7aa6-49a0-b269-a833010f6cc9 could not be found. Aug 17 08:43:41.752992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:43:41.754658 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c3dfc2eb-74f6-4855-9d7b-2f4a1cc366e3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Returning 404 to user: Instance c224c091-7aa6-49a0-b269-a833010f6cc9 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:43:41.754658 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c3dfc2eb-74f6-4855-9d7b-2f4a1cc366e3 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 404 len: 111 microversion: 2.1 time: 0.031827 Aug 17 08:43:41.754658 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 296/594] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:43:41 2022] DELETE /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:43:41.758717 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c40a5dcd-adf9-467b-8fe8-1b2027c2ddd4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:41.759325 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c40a5dcd-adf9-467b-8fe8-1b2027c2ddd4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] [instance: c224c091-7aa6-49a0-b269-a833010f6cc9] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:41.766370 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c40a5dcd-adf9-467b-8fe8-1b2027c2ddd4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:41.766853 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c40a5dcd-adf9-467b-8fe8-1b2027c2ddd4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:41.767346 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c40a5dcd-adf9-467b-8fe8-1b2027c2ddd4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:41.768113 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c40a5dcd-adf9-467b-8fe8-1b2027c2ddd4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:41.768570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c40a5dcd-adf9-467b-8fe8-1b2027c2ddd4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:41.768995 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c40a5dcd-adf9-467b-8fe8-1b2027c2ddd4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:41.783033 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-c40a5dcd-adf9-467b-8fe8-1b2027c2ddd4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] HTTP exception thrown: Instance c224c091-7aa6-49a0-b269-a833010f6cc9 could not be found. Aug 17 08:43:41.784478 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c40a5dcd-adf9-467b-8fe8-1b2027c2ddd4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Request method failure captured: Aug 17 08:43:41.784478 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 HTTP/1.1 Aug 17 08:43:41.784478 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:43:41.784478 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:43:41.784478 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:43:41.784478 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:43:41.784478 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:43:41.784478 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:43:41.784478 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:43:41.784478 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:43:41.784478 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_KjiKWJZjWgNbqmM28Vjeu9R6ZeIg5FUJHEdYYZsokkrIlIQwAPOg76kV16_SM9dgrm4x4Ey7Bv5JK8yPNlJwFgI2TgzaNGCXIKf-RoVGXcv-LXAgcfo4Z6IqpCOKy8uSUOrF5FFN1LyukP3O_Z1I_aP4J27HRvibpbPvmhWPu10h-k Aug 17 08:43:41.784478 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:43:41.784478 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:43:41.784478 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:43:41.784478 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:43:41.784478 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:43:41.784478 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:43:41.784478 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: 458a894213fa47d78568eefbb75f05b3 Aug 17 08:43:41.784478 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-AttachVolumeTestJSON-2031567907 Aug 17 08:43:41.784478 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:43:41.784478 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:43:41.786056 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/458a894213fa47d78568eefbb75f05b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/458a894213fa47d78568eefbb75f05b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/458a894213fa47d78568eefbb75f05b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_458a894213fa47d78568eefbb75f05b3", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:43:41.786056 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-AttachVolumeTestJSON-2031567907 Aug 17 08:43:41.786056 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 458a894213fa47d78568eefbb75f05b3 Aug 17 08:43:41.786056 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2031567907 Aug 17 08:43:41.786056 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-AttachVolumeTestJSON-2031567907-project Aug 17 08:43:41.786056 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:43:41.786056 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:43:41.786056 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: d0aea5553e1043889571c50c3b01cacc Aug 17 08:43:41.786056 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-AttachVolumeTestJSON-2031567907-project Aug 17 08:43:41.786056 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: > Aug 17 08:43:41.786056 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Instance c224c091-7aa6-49a0-b269-a833010f6cc9 could not be found. Aug 17 08:43:41.786056 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': 'c224c091-7aa6-49a0-b269-a833010f6cc9'} Aug 17 08:43:41.786894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:43:41.786894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:43:41.786894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:43:41.786894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:43:41.786894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:43:41.786894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:43:41.786894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:43:41.786894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:43:41.786894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:43:41.786894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:43:41.786894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c224c091-7aa6-49a0-b269-a833010f6cc9 could not be found. Aug 17 08:43:41.786894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:43:41.786894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:43:41.786894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:43:41.786894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:43:41.786894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:43:41.786894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:43:41.786894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:43:41.786894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:43:41.786894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:43:41.788151 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:43:41.788151 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:43:41.788151 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:43:41.788151 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:43:41.788151 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:43:41.788151 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:43:41.788151 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:43:41.788151 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c224c091-7aa6-49a0-b269-a833010f6cc9 could not be found. Aug 17 08:43:41.788151 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:43:41.788151 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:43:41.788151 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:43:41.788151 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:43:41.788151 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:43:41.788151 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:43:41.788151 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:43:41.788151 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:43:41.788151 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c224c091-7aa6-49a0-b269-a833010f6cc9 could not be found. Aug 17 08:43:41.788151 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:43:41.789241 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c40a5dcd-adf9-467b-8fe8-1b2027c2ddd4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] Returning 404 to user: Instance c224c091-7aa6-49a0-b269-a833010f6cc9 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:43:41.789241 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c40a5dcd-adf9-467b-8fe8-1b2027c2ddd4 tempest-AttachVolumeTestJSON-2031567907 tempest-AttachVolumeTestJSON-2031567907-project] 10.222.0.15 "GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9" status: 404 len: 111 microversion: 2.1 time: 0.031003 Aug 17 08:43:41.789241 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 299/595] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:41 2022] GET /compute/v2.1/servers/c224c091-7aa6-49a0-b269-a833010f6cc9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:43:50.098350 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a2ebccf6-a2aa-49fa-90ff-be1a0101781a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Action: 'create', calling method: .version_select at 0x7f3f85225040>, body: {"keypair": {"name": "tempest-keypair-1374923207", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBq84ApgLs52/QqwMKmjUZOgbC7eAu7csUJcxXFtopxw5rwfjxvPGZ57ybQdOaD7bBTon/TYxUvS4t2ABbGQQnvPDGg9rtdx2i4muu2kY4B5g/DyCVHkVtvzFfyIRkWBBg=="}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:43:50.103813 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:43:50.116836 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-a2ebccf6-a2aa-49fa-90ff-be1a0101781a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Getting quotas for project 34b106e46b2c4fb292353a6176c9f699. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:43:50.121228 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-a2ebccf6-a2aa-49fa-90ff-be1a0101781a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Getting quotas for user 49114d25c04144269e3eb88448e2c2ee and project 34b106e46b2c4fb292353a6176c9f699. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:43:50.144508 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a2ebccf6-a2aa-49fa-90ff-be1a0101781a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.165363 Aug 17 08:43:50.145212 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 297/596] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 08:43:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:43:51.394628 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7afc1770-6ab6-477b-82bd-6e6e2ecc61ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-722420872", "imageRef": "4467450c-a35c-42e3-af85-a13291b0b2aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "57fc802a-439c-414a-9558-62dc475889bd"}], "security_groups": [{"name": "tempest-securitygroup--320407294"}], "key_name": "tempest-keypair-1374923207", "user_data": "}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:43:51.404648 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:43:51.509593 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.network.neutron [None req-7afc1770-6ab6-477b-82bd-6e6e2ecc61ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] validate_networks() for [('57fc802a-439c-414a-9558-62dc475889bd', None, None, None, None, None)] {{(pid=127297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 08:43:51.773410 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=13 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:43:51.933517 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-7afc1770-6ab6-477b-82bd-6e6e2ecc61ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Flavor limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 08:43:51.933937 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-7afc1770-6ab6-477b-82bd-6e6e2ecc61ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Image limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 08:43:51.934410 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-7afc1770-6ab6-477b-82bd-6e6e2ecc61ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Flavor pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 08:43:51.934818 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-7afc1770-6ab6-477b-82bd-6e6e2ecc61ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Image pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 08:43:51.935228 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-7afc1770-6ab6-477b-82bd-6e6e2ecc61ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 08:43:51.943931 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7afc1770-6ab6-477b-82bd-6e6e2ecc61ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:51.944411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7afc1770-6ab6-477b-82bd-6e6e2ecc61ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:51.944868 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7afc1770-6ab6-477b-82bd-6e6e2ecc61ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:51.945589 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7afc1770-6ab6-477b-82bd-6e6e2ecc61ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:51.946066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7afc1770-6ab6-477b-82bd-6e6e2ecc61ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:51.946514 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7afc1770-6ab6-477b-82bd-6e6e2ecc61ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:51.963490 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-7afc1770-6ab6-477b-82bd-6e6e2ecc61ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Getting quotas for project 34b106e46b2c4fb292353a6176c9f699. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:43:51.969155 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-7afc1770-6ab6-477b-82bd-6e6e2ecc61ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Getting quotas for user 49114d25c04144269e3eb88448e2c2ee and project 34b106e46b2c4fb292353a6176c9f699. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:43:51.979230 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7afc1770-6ab6-477b-82bd-6e6e2ecc61ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Going to run 1 instances... {{(pid=127297) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 08:43:51.982152 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7afc1770-6ab6-477b-82bd-6e6e2ecc61ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4467450c-a35c-42e3-af85-a13291b0b2aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 08:43:52.027038 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-7afc1770-6ab6-477b-82bd-6e6e2ecc61ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.636891 Aug 17 08:43:52.028436 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 300/597] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 08:43:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 08:43:52.036219 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:43:52.040543 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6b43865d-d3c1-4acd-891c-82d4065811cf tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:52.041618 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6b43865d-d3c1-4acd-891c-82d4065811cf tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:52.101041 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6b43865d-d3c1-4acd-891c-82d4065811cf tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:52.111255 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6b43865d-d3c1-4acd-891c-82d4065811cf tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972" status: 200 len: 1241 microversion: 2.1 time: 0.076087 Aug 17 08:43:52.121147 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 298/598] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:52 2022] GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972 => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:53.132887 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d3327a60-f41b-4cd0-b9d3-2ae319f08a46 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:53.133494 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d3327a60-f41b-4cd0-b9d3-2ae319f08a46 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:53.141017 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d3327a60-f41b-4cd0-b9d3-2ae319f08a46 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:53.141737 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d3327a60-f41b-4cd0-b9d3-2ae319f08a46 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:53.142172 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d3327a60-f41b-4cd0-b9d3-2ae319f08a46 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:53.142862 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d3327a60-f41b-4cd0-b9d3-2ae319f08a46 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:53.143592 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d3327a60-f41b-4cd0-b9d3-2ae319f08a46 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:53.144206 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d3327a60-f41b-4cd0-b9d3-2ae319f08a46 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:53.233390 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d3327a60-f41b-4cd0-b9d3-2ae319f08a46 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:53.244839 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d3327a60-f41b-4cd0-b9d3-2ae319f08a46 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972" status: 200 len: 1301 microversion: 2.1 time: 0.116975 Aug 17 08:43:53.256726 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 301/599] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:53 2022] GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972 => generated 1301 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:54.267611 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-db624379-6f1d-440e-a1be-b93891d257e7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:54.268188 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-db624379-6f1d-440e-a1be-b93891d257e7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:54.274492 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-db624379-6f1d-440e-a1be-b93891d257e7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:54.274972 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-db624379-6f1d-440e-a1be-b93891d257e7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:54.275403 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-db624379-6f1d-440e-a1be-b93891d257e7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:54.276120 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-db624379-6f1d-440e-a1be-b93891d257e7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:54.276572 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-db624379-6f1d-440e-a1be-b93891d257e7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:54.276984 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-db624379-6f1d-440e-a1be-b93891d257e7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:54.414857 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-db624379-6f1d-440e-a1be-b93891d257e7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:54.422932 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-db624379-6f1d-440e-a1be-b93891d257e7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972" status: 200 len: 1366 microversion: 2.1 time: 0.159151 Aug 17 08:43:54.423495 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 299/600] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:54 2022] GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:54.736206 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-9eab2c1f-7b9c-4cb8-89df-15bc470280f2 req-055aed2e-929b-40b2-a6c6-a7372ea75c5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e566e58-543c-4264-bee0-185da5050972", "tag": "1bba73d1-dc37-4c6f-a150-b9806ac22bda"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:43:54.745948 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-9eab2c1f-7b9c-4cb8-89df-15bc470280f2 req-055aed2e-929b-40b2-a6c6-a7372ea75c5b service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:54.746419 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-9eab2c1f-7b9c-4cb8-89df-15bc470280f2 req-055aed2e-929b-40b2-a6c6-a7372ea75c5b service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:54.746884 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-9eab2c1f-7b9c-4cb8-89df-15bc470280f2 req-055aed2e-929b-40b2-a6c6-a7372ea75c5b service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:54.757530 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-9eab2c1f-7b9c-4cb8-89df-15bc470280f2 req-055aed2e-929b-40b2-a6c6-a7372ea75c5b service nova] Creating event network-changed:1bba73d1-dc37-4c6f-a150-b9806ac22bda for instance 3e566e58-543c-4264-bee0-185da5050972 on hv-cinder-85331 Aug 17 08:43:54.762857 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-9eab2c1f-7b9c-4cb8-89df-15bc470280f2 req-055aed2e-929b-40b2-a6c6-a7372ea75c5b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029758 Aug 17 08:43:54.763453 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 302/601] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:43:55.443728 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b1762c4c-9feb-4c67-b06b-ca9058968237 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:55.444337 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b1762c4c-9feb-4c67-b06b-ca9058968237 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:55.450936 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b1762c4c-9feb-4c67-b06b-ca9058968237 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:55.451444 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b1762c4c-9feb-4c67-b06b-ca9058968237 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:55.451903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b1762c4c-9feb-4c67-b06b-ca9058968237 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:55.452637 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b1762c4c-9feb-4c67-b06b-ca9058968237 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:55.453082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b1762c4c-9feb-4c67-b06b-ca9058968237 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:55.453766 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b1762c4c-9feb-4c67-b06b-ca9058968237 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:55.582021 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b1762c4c-9feb-4c67-b06b-ca9058968237 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:55.589530 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b1762c4c-9feb-4c67-b06b-ca9058968237 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972" status: 200 len: 1366 microversion: 2.1 time: 0.149699 Aug 17 08:43:55.597685 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 300/602] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:55 2022] GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:56.611285 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2ecbebd3-4f57-4554-a280-802278678956 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:56.612564 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-2ecbebd3-4f57-4554-a280-802278678956 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:56.618662 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2ecbebd3-4f57-4554-a280-802278678956 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:56.619087 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2ecbebd3-4f57-4554-a280-802278678956 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:56.619515 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2ecbebd3-4f57-4554-a280-802278678956 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:56.620233 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2ecbebd3-4f57-4554-a280-802278678956 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:56.620663 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2ecbebd3-4f57-4554-a280-802278678956 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:56.621083 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2ecbebd3-4f57-4554-a280-802278678956 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:56.809751 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-2ecbebd3-4f57-4554-a280-802278678956 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:56.817155 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2ecbebd3-4f57-4554-a280-802278678956 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972" status: 200 len: 1366 microversion: 2.1 time: 0.210567 Aug 17 08:43:56.817734 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 303/603] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:56 2022] GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:57.838271 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-442b0f6e-6afb-4914-957b-80a58a274ff5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:57.839004 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-442b0f6e-6afb-4914-957b-80a58a274ff5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:57.846611 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-442b0f6e-6afb-4914-957b-80a58a274ff5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:57.847099 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-442b0f6e-6afb-4914-957b-80a58a274ff5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:57.847533 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-442b0f6e-6afb-4914-957b-80a58a274ff5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:57.848459 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-442b0f6e-6afb-4914-957b-80a58a274ff5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:57.848939 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-442b0f6e-6afb-4914-957b-80a58a274ff5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:57.849377 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-442b0f6e-6afb-4914-957b-80a58a274ff5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:57.981505 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-442b0f6e-6afb-4914-957b-80a58a274ff5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:57.988835 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-442b0f6e-6afb-4914-957b-80a58a274ff5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972" status: 200 len: 1366 microversion: 2.1 time: 0.154858 Aug 17 08:43:57.989391 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 301/604] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:57 2022] GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:59.009530 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5a1dcd70-caa2-4270-ba77-cd483c3e80b9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:43:59.010158 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-5a1dcd70-caa2-4270-ba77-cd483c3e80b9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:43:59.016407 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5a1dcd70-caa2-4270-ba77-cd483c3e80b9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:59.016880 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5a1dcd70-caa2-4270-ba77-cd483c3e80b9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:59.017306 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5a1dcd70-caa2-4270-ba77-cd483c3e80b9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:59.017972 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5a1dcd70-caa2-4270-ba77-cd483c3e80b9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:59.018413 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5a1dcd70-caa2-4270-ba77-cd483c3e80b9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:59.018823 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5a1dcd70-caa2-4270-ba77-cd483c3e80b9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:59.146483 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-5a1dcd70-caa2-4270-ba77-cd483c3e80b9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:43:59.153747 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-5a1dcd70-caa2-4270-ba77-cd483c3e80b9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972" status: 200 len: 1366 microversion: 2.1 time: 0.148069 Aug 17 08:43:59.154300 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 304/605] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:43:59 2022] GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:43:59.462545 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-50388fe3-2d03-4cce-b18e-01d23634b276 req-b0f8b0da-db78-4970-948a-9b6bd65ec208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e566e58-543c-4264-bee0-185da5050972", "name": "network-vif-plugged", "status": "completed", "tag": "1bba73d1-dc37-4c6f-a150-b9806ac22bda"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:43:59.473120 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-50388fe3-2d03-4cce-b18e-01d23634b276 req-b0f8b0da-db78-4970-948a-9b6bd65ec208 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:43:59.473654 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-50388fe3-2d03-4cce-b18e-01d23634b276 req-b0f8b0da-db78-4970-948a-9b6bd65ec208 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:43:59.474072 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-50388fe3-2d03-4cce-b18e-01d23634b276 req-b0f8b0da-db78-4970-948a-9b6bd65ec208 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:43:59.486051 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-50388fe3-2d03-4cce-b18e-01d23634b276 req-b0f8b0da-db78-4970-948a-9b6bd65ec208 service nova] Creating event network-vif-plugged:1bba73d1-dc37-4c6f-a150-b9806ac22bda for instance 3e566e58-543c-4264-bee0-185da5050972 on hv-cinder-85331 Aug 17 08:43:59.491034 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-50388fe3-2d03-4cce-b18e-01d23634b276 req-b0f8b0da-db78-4970-948a-9b6bd65ec208 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032215 Aug 17 08:43:59.491954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 302/606] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:44:00.173915 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a2e95522-ff6f-48eb-a44c-fcdb8e6bc1d5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:00.174522 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a2e95522-ff6f-48eb-a44c-fcdb8e6bc1d5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:00.180883 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a2e95522-ff6f-48eb-a44c-fcdb8e6bc1d5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:00.181361 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a2e95522-ff6f-48eb-a44c-fcdb8e6bc1d5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:00.181792 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a2e95522-ff6f-48eb-a44c-fcdb8e6bc1d5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:00.182473 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a2e95522-ff6f-48eb-a44c-fcdb8e6bc1d5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:00.182922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a2e95522-ff6f-48eb-a44c-fcdb8e6bc1d5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:00.183341 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a2e95522-ff6f-48eb-a44c-fcdb8e6bc1d5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:00.315258 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a2e95522-ff6f-48eb-a44c-fcdb8e6bc1d5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:00.322651 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a2e95522-ff6f-48eb-a44c-fcdb8e6bc1d5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972" status: 200 len: 1366 microversion: 2.1 time: 0.152530 Aug 17 08:44:00.323241 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 305/607] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:44:00 2022] GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:44:01.345036 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-219461e4-9e27-4ed1-8a5a-222ab03e77f9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:01.345722 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-219461e4-9e27-4ed1-8a5a-222ab03e77f9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:01.352062 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-219461e4-9e27-4ed1-8a5a-222ab03e77f9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:01.352545 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-219461e4-9e27-4ed1-8a5a-222ab03e77f9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:01.353019 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-219461e4-9e27-4ed1-8a5a-222ab03e77f9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:01.353697 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-219461e4-9e27-4ed1-8a5a-222ab03e77f9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:01.354144 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-219461e4-9e27-4ed1-8a5a-222ab03e77f9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:01.354563 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-219461e4-9e27-4ed1-8a5a-222ab03e77f9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:01.488070 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-219461e4-9e27-4ed1-8a5a-222ab03e77f9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:01.495482 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-219461e4-9e27-4ed1-8a5a-222ab03e77f9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972" status: 200 len: 1556 microversion: 2.1 time: 0.155164 Aug 17 08:44:01.496063 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 303/608] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:44:01 2022] GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:44:01.515656 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1d7ad04d-efee-4bce-9999-2641e93cc88b tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:01.516136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1d7ad04d-efee-4bce-9999-2641e93cc88b tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:01.522390 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1d7ad04d-efee-4bce-9999-2641e93cc88b tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:01.522864 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1d7ad04d-efee-4bce-9999-2641e93cc88b tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:01.523289 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1d7ad04d-efee-4bce-9999-2641e93cc88b tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:01.524005 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1d7ad04d-efee-4bce-9999-2641e93cc88b tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:01.524452 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1d7ad04d-efee-4bce-9999-2641e93cc88b tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:01.524868 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1d7ad04d-efee-4bce-9999-2641e93cc88b tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:01.600957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1d7ad04d-efee-4bce-9999-2641e93cc88b tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089056 Aug 17 08:44:01.601563 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 306/609] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 17 08:44:01 2022] GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:44:02.506728 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=6 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:44:02.561912 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-489da8bf-544b-4528-ac7b-07a85a72d971 req-7a736415-8425-4c02-9d9b-355bd4637358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e566e58-543c-4264-bee0-185da5050972", "tag": "1bba73d1-dc37-4c6f-a150-b9806ac22bda"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:44:02.582977 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-489da8bf-544b-4528-ac7b-07a85a72d971 req-7a736415-8425-4c02-9d9b-355bd4637358 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:02.583457 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-489da8bf-544b-4528-ac7b-07a85a72d971 req-7a736415-8425-4c02-9d9b-355bd4637358 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:02.584118 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-489da8bf-544b-4528-ac7b-07a85a72d971 req-7a736415-8425-4c02-9d9b-355bd4637358 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:02.596009 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-489da8bf-544b-4528-ac7b-07a85a72d971 req-7a736415-8425-4c02-9d9b-355bd4637358 service nova] Creating event network-changed:1bba73d1-dc37-4c6f-a150-b9806ac22bda for instance 3e566e58-543c-4264-bee0-185da5050972 on hv-cinder-85331 Aug 17 08:44:02.600747 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-489da8bf-544b-4528-ac7b-07a85a72d971 req-7a736415-8425-4c02-9d9b-355bd4637358 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098486 Aug 17 08:44:02.601509 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 304/610] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:44:03.106530 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d50fd7c9-b8b2-4400-b392-7b55ac4f0b50 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:03.107163 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d50fd7c9-b8b2-4400-b392-7b55ac4f0b50 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:03.109344 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:44:03.110010 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=6 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:44:03.117261 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d50fd7c9-b8b2-4400-b392-7b55ac4f0b50 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:03.118008 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d50fd7c9-b8b2-4400-b392-7b55ac4f0b50 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:03.118543 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d50fd7c9-b8b2-4400-b392-7b55ac4f0b50 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:03.119434 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d50fd7c9-b8b2-4400-b392-7b55ac4f0b50 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:03.119710 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d50fd7c9-b8b2-4400-b392-7b55ac4f0b50 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:03.120340 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d50fd7c9-b8b2-4400-b392-7b55ac4f0b50 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:03.145782 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d50fd7c9-b8b2-4400-b392-7b55ac4f0b50 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032/ips" status: 200 len: 152 microversion: 2.20 time: 0.043080 Aug 17 08:44:03.146356 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 307/611] 10.222.0.15 () {60 vars in 1289 bytes} [Wed Aug 17 08:44:03 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 08:44:05.184913 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-754aceb9-4535-4203-bd72-20fd9f570f29 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:44:05.185518 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-754aceb9-4535-4203-bd72-20fd9f570f29 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:05.191571 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-754aceb9-4535-4203-bd72-20fd9f570f29 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:05.192051 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-754aceb9-4535-4203-bd72-20fd9f570f29 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:05.192480 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-754aceb9-4535-4203-bd72-20fd9f570f29 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:05.193150 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-754aceb9-4535-4203-bd72-20fd9f570f29 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:05.193593 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-754aceb9-4535-4203-bd72-20fd9f570f29 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:05.194002 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-754aceb9-4535-4203-bd72-20fd9f570f29 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:05.217781 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-754aceb9-4535-4203-bd72-20fd9f570f29 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lazy-loading 'flavor' on Instance uuid 42e06cf4-bb49-4d51-93c1-3147069bd032 {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:44:05.396260 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-754aceb9-4535-4203-bd72-20fd9f570f29 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "POST /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032/action" status: 202 len: 0 microversion: 2.20 time: 0.216489 Aug 17 08:44:05.396990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 305/612] 10.222.0.15 () {62 vars in 1319 bytes} [Wed Aug 17 08:44:05 2022] POST /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 08:44:05.406000 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-96159379-49d4-4d72-bc7e-5012ec4c56c2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:05.406680 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-96159379-49d4-4d72-bc7e-5012ec4c56c2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:05.412547 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-96159379-49d4-4d72-bc7e-5012ec4c56c2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:05.413024 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-96159379-49d4-4d72-bc7e-5012ec4c56c2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:05.413450 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-96159379-49d4-4d72-bc7e-5012ec4c56c2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:05.414175 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-96159379-49d4-4d72-bc7e-5012ec4c56c2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:05.414688 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-96159379-49d4-4d72-bc7e-5012ec4c56c2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:05.415272 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-96159379-49d4-4d72-bc7e-5012ec4c56c2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:05.547362 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-96159379-49d4-4d72-bc7e-5012ec4c56c2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:05.555170 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-96159379-49d4-4d72-bc7e-5012ec4c56c2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:05.556691 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-96159379-49d4-4d72-bc7e-5012ec4c56c2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:05.558024 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-96159379-49d4-4d72-bc7e-5012ec4c56c2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1722 microversion: 2.20 time: 0.156444 Aug 17 08:44:05.558600 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 308/613] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:05 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:06.581704 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ea84632d-7867-4e02-96ba-0d71437bb299 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:06.582380 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ea84632d-7867-4e02-96ba-0d71437bb299 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:06.588534 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ea84632d-7867-4e02-96ba-0d71437bb299 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:06.589002 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ea84632d-7867-4e02-96ba-0d71437bb299 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:06.589429 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ea84632d-7867-4e02-96ba-0d71437bb299 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:06.590098 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ea84632d-7867-4e02-96ba-0d71437bb299 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:06.590538 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ea84632d-7867-4e02-96ba-0d71437bb299 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:06.590951 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ea84632d-7867-4e02-96ba-0d71437bb299 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:06.721083 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ea84632d-7867-4e02-96ba-0d71437bb299 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:06.728997 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ea84632d-7867-4e02-96ba-0d71437bb299 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:06.730430 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ea84632d-7867-4e02-96ba-0d71437bb299 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:06.731581 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ea84632d-7867-4e02-96ba-0d71437bb299 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1722 microversion: 2.20 time: 0.154834 Aug 17 08:44:06.732194 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 306/614] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:06 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:07.754153 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c36f6299-6e57-4f77-b5a0-de7200164134 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:07.754753 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c36f6299-6e57-4f77-b5a0-de7200164134 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:07.761178 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c36f6299-6e57-4f77-b5a0-de7200164134 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:07.761655 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c36f6299-6e57-4f77-b5a0-de7200164134 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:07.762102 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c36f6299-6e57-4f77-b5a0-de7200164134 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:07.762776 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c36f6299-6e57-4f77-b5a0-de7200164134 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:07.763221 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c36f6299-6e57-4f77-b5a0-de7200164134 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:07.763670 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c36f6299-6e57-4f77-b5a0-de7200164134 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:07.891457 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c36f6299-6e57-4f77-b5a0-de7200164134 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:07.899296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c36f6299-6e57-4f77-b5a0-de7200164134 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:07.900831 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c36f6299-6e57-4f77-b5a0-de7200164134 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:07.901963 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c36f6299-6e57-4f77-b5a0-de7200164134 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1722 microversion: 2.20 time: 0.151737 Aug 17 08:44:07.903022 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 309/615] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:07 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:08.925762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-952af88d-d740-4df5-a4e4-28417da659b3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:08.926358 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-952af88d-d740-4df5-a4e4-28417da659b3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:08.932169 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-952af88d-d740-4df5-a4e4-28417da659b3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:08.932643 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-952af88d-d740-4df5-a4e4-28417da659b3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:08.933065 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-952af88d-d740-4df5-a4e4-28417da659b3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:08.933735 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-952af88d-d740-4df5-a4e4-28417da659b3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:08.934176 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-952af88d-d740-4df5-a4e4-28417da659b3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:08.934591 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-952af88d-d740-4df5-a4e4-28417da659b3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:09.059803 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-952af88d-d740-4df5-a4e4-28417da659b3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:09.067878 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-952af88d-d740-4df5-a4e4-28417da659b3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:09.069373 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-952af88d-d740-4df5-a4e4-28417da659b3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:09.070503 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-952af88d-d740-4df5-a4e4-28417da659b3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1722 microversion: 2.20 time: 0.149012 Aug 17 08:44:09.071051 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 307/616] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:08 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:10.093923 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-95c309e2-95d9-461d-b471-33799e0f8da1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:10.094524 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-95c309e2-95d9-461d-b471-33799e0f8da1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:10.101018 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95c309e2-95d9-461d-b471-33799e0f8da1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:10.101500 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95c309e2-95d9-461d-b471-33799e0f8da1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:10.101935 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95c309e2-95d9-461d-b471-33799e0f8da1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:10.102616 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95c309e2-95d9-461d-b471-33799e0f8da1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:10.103071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95c309e2-95d9-461d-b471-33799e0f8da1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:10.103490 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95c309e2-95d9-461d-b471-33799e0f8da1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:10.229137 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-95c309e2-95d9-461d-b471-33799e0f8da1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:10.237492 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-95c309e2-95d9-461d-b471-33799e0f8da1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:10.238980 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-95c309e2-95d9-461d-b471-33799e0f8da1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:10.240148 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-95c309e2-95d9-461d-b471-33799e0f8da1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1722 microversion: 2.20 time: 0.150193 Aug 17 08:44:10.240708 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 310/617] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:10 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:11.263226 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-60885085-6759-473a-8611-770c59cda022 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:11.263853 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-60885085-6759-473a-8611-770c59cda022 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:11.270193 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-60885085-6759-473a-8611-770c59cda022 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:11.270668 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-60885085-6759-473a-8611-770c59cda022 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:11.271095 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-60885085-6759-473a-8611-770c59cda022 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:11.271803 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-60885085-6759-473a-8611-770c59cda022 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:11.272249 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-60885085-6759-473a-8611-770c59cda022 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:11.272691 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-60885085-6759-473a-8611-770c59cda022 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:11.401512 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-60885085-6759-473a-8611-770c59cda022 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:11.409807 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-60885085-6759-473a-8611-770c59cda022 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:11.411305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-60885085-6759-473a-8611-770c59cda022 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:11.412488 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-60885085-6759-473a-8611-770c59cda022 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1722 microversion: 2.20 time: 0.153047 Aug 17 08:44:11.413042 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 308/618] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:11 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:12.435588 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-636d0b3a-0b38-4878-9268-5271977e9023 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:12.436178 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-636d0b3a-0b38-4878-9268-5271977e9023 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:12.442496 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-636d0b3a-0b38-4878-9268-5271977e9023 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:12.442969 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-636d0b3a-0b38-4878-9268-5271977e9023 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:12.443392 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-636d0b3a-0b38-4878-9268-5271977e9023 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:12.444091 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-636d0b3a-0b38-4878-9268-5271977e9023 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:12.444540 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-636d0b3a-0b38-4878-9268-5271977e9023 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:12.444954 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-636d0b3a-0b38-4878-9268-5271977e9023 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:12.571961 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-636d0b3a-0b38-4878-9268-5271977e9023 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:12.580525 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-636d0b3a-0b38-4878-9268-5271977e9023 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:12.582010 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-636d0b3a-0b38-4878-9268-5271977e9023 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:12.583136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-636d0b3a-0b38-4878-9268-5271977e9023 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1722 microversion: 2.20 time: 0.151484 Aug 17 08:44:12.583721 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 311/619] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:12 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:13.606744 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-280e3f55-6587-4e93-ae79-334b4d6c1ca3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:13.607261 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-280e3f55-6587-4e93-ae79-334b4d6c1ca3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:13.613822 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-280e3f55-6587-4e93-ae79-334b4d6c1ca3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:13.614292 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-280e3f55-6587-4e93-ae79-334b4d6c1ca3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:13.614719 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-280e3f55-6587-4e93-ae79-334b4d6c1ca3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:13.615413 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-280e3f55-6587-4e93-ae79-334b4d6c1ca3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:13.615890 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-280e3f55-6587-4e93-ae79-334b4d6c1ca3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:13.616301 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-280e3f55-6587-4e93-ae79-334b4d6c1ca3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:13.741879 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-280e3f55-6587-4e93-ae79-334b4d6c1ca3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:13.749644 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-280e3f55-6587-4e93-ae79-334b4d6c1ca3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:13.751154 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-280e3f55-6587-4e93-ae79-334b4d6c1ca3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:13.752297 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-280e3f55-6587-4e93-ae79-334b4d6c1ca3 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1722 microversion: 2.20 time: 0.150097 Aug 17 08:44:13.752850 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 309/620] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:13 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:14.774766 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-773679ce-88a4-47db-9106-1196250000c2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:14.775281 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-773679ce-88a4-47db-9106-1196250000c2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:14.781922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-773679ce-88a4-47db-9106-1196250000c2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:14.782424 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-773679ce-88a4-47db-9106-1196250000c2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:14.782850 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-773679ce-88a4-47db-9106-1196250000c2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:14.783516 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-773679ce-88a4-47db-9106-1196250000c2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:14.783978 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-773679ce-88a4-47db-9106-1196250000c2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:14.784391 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-773679ce-88a4-47db-9106-1196250000c2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:14.916237 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-773679ce-88a4-47db-9106-1196250000c2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:14.924618 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-773679ce-88a4-47db-9106-1196250000c2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:14.926107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-773679ce-88a4-47db-9106-1196250000c2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:14.927242 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-773679ce-88a4-47db-9106-1196250000c2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1722 microversion: 2.20 time: 0.156464 Aug 17 08:44:14.927834 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 312/621] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:14 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:15.950889 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-28753112-a386-4342-bfb5-5c14ba857a08 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:15.951485 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-28753112-a386-4342-bfb5-5c14ba857a08 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:15.958207 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-28753112-a386-4342-bfb5-5c14ba857a08 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:15.958684 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-28753112-a386-4342-bfb5-5c14ba857a08 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:15.959113 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-28753112-a386-4342-bfb5-5c14ba857a08 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:15.959826 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-28753112-a386-4342-bfb5-5c14ba857a08 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:15.960278 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-28753112-a386-4342-bfb5-5c14ba857a08 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:15.960692 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-28753112-a386-4342-bfb5-5c14ba857a08 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:16.088823 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-28753112-a386-4342-bfb5-5c14ba857a08 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:16.096761 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-28753112-a386-4342-bfb5-5c14ba857a08 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:16.098244 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-28753112-a386-4342-bfb5-5c14ba857a08 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:16.099369 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-28753112-a386-4342-bfb5-5c14ba857a08 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1722 microversion: 2.20 time: 0.152991 Aug 17 08:44:16.099960 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 310/622] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:15 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:17.122046 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0a32d96c-dc1d-45c9-a99b-6bf4bd8ce96e tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:17.122644 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0a32d96c-dc1d-45c9-a99b-6bf4bd8ce96e tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:17.129057 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a32d96c-dc1d-45c9-a99b-6bf4bd8ce96e tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:17.129535 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a32d96c-dc1d-45c9-a99b-6bf4bd8ce96e tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:17.129961 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a32d96c-dc1d-45c9-a99b-6bf4bd8ce96e tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:17.130638 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a32d96c-dc1d-45c9-a99b-6bf4bd8ce96e tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:17.131085 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a32d96c-dc1d-45c9-a99b-6bf4bd8ce96e tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:17.131505 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0a32d96c-dc1d-45c9-a99b-6bf4bd8ce96e tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:17.257064 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0a32d96c-dc1d-45c9-a99b-6bf4bd8ce96e tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:17.265512 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0a32d96c-dc1d-45c9-a99b-6bf4bd8ce96e tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:17.267003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0a32d96c-dc1d-45c9-a99b-6bf4bd8ce96e tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:17.268167 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0a32d96c-dc1d-45c9-a99b-6bf4bd8ce96e tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1722 microversion: 2.20 time: 0.150039 Aug 17 08:44:17.268732 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 313/623] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:17 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:18.290869 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0a26ab49-298b-444f-ac91-362cc1e9d314 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:18.291464 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0a26ab49-298b-444f-ac91-362cc1e9d314 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:18.297978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0a26ab49-298b-444f-ac91-362cc1e9d314 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:18.298454 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0a26ab49-298b-444f-ac91-362cc1e9d314 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:18.298882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0a26ab49-298b-444f-ac91-362cc1e9d314 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:18.299576 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0a26ab49-298b-444f-ac91-362cc1e9d314 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:18.300028 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0a26ab49-298b-444f-ac91-362cc1e9d314 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:18.300446 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0a26ab49-298b-444f-ac91-362cc1e9d314 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:18.428743 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0a26ab49-298b-444f-ac91-362cc1e9d314 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:18.437096 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0a26ab49-298b-444f-ac91-362cc1e9d314 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:18.438619 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0a26ab49-298b-444f-ac91-362cc1e9d314 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:18.439797 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0a26ab49-298b-444f-ac91-362cc1e9d314 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1722 microversion: 2.20 time: 0.152745 Aug 17 08:44:18.440356 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 311/624] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:18 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:19.462175 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-84305cef-a3e7-416e-8191-614ea84e138f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:19.462781 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-84305cef-a3e7-416e-8191-614ea84e138f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:19.469187 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-84305cef-a3e7-416e-8191-614ea84e138f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:19.469668 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-84305cef-a3e7-416e-8191-614ea84e138f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:19.470102 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-84305cef-a3e7-416e-8191-614ea84e138f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:19.470783 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-84305cef-a3e7-416e-8191-614ea84e138f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:19.471234 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-84305cef-a3e7-416e-8191-614ea84e138f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:19.471684 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-84305cef-a3e7-416e-8191-614ea84e138f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:19.601670 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-84305cef-a3e7-416e-8191-614ea84e138f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:19.610268 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-84305cef-a3e7-416e-8191-614ea84e138f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:19.611810 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-84305cef-a3e7-416e-8191-614ea84e138f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:19.612951 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-84305cef-a3e7-416e-8191-614ea84e138f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1722 microversion: 2.20 time: 0.154634 Aug 17 08:44:19.613517 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 314/625] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:19 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:20.636776 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8821772a-3476-46de-a3d6-13eb8b552565 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:20.637363 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8821772a-3476-46de-a3d6-13eb8b552565 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:20.640066 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:44:20.645452 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8821772a-3476-46de-a3d6-13eb8b552565 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:20.645926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8821772a-3476-46de-a3d6-13eb8b552565 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:20.646352 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8821772a-3476-46de-a3d6-13eb8b552565 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:20.647022 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8821772a-3476-46de-a3d6-13eb8b552565 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:20.647465 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8821772a-3476-46de-a3d6-13eb8b552565 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:20.647907 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8821772a-3476-46de-a3d6-13eb8b552565 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:20.778723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8821772a-3476-46de-a3d6-13eb8b552565 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:20.786579 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8821772a-3476-46de-a3d6-13eb8b552565 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:20.788086 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8821772a-3476-46de-a3d6-13eb8b552565 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:20.789208 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8821772a-3476-46de-a3d6-13eb8b552565 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1722 microversion: 2.20 time: 0.156882 Aug 17 08:44:20.789754 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 312/626] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:20 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:21.811836 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c776924c-a46d-48dc-a289-28989134aff9 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:21.812887 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c776924c-a46d-48dc-a289-28989134aff9 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:21.816912 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:44:21.822617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c776924c-a46d-48dc-a289-28989134aff9 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:21.823109 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c776924c-a46d-48dc-a289-28989134aff9 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:21.823563 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c776924c-a46d-48dc-a289-28989134aff9 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:21.824766 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c776924c-a46d-48dc-a289-28989134aff9 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:21.825216 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c776924c-a46d-48dc-a289-28989134aff9 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:21.825641 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c776924c-a46d-48dc-a289-28989134aff9 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:21.830781 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=79 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:44:21.959609 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c776924c-a46d-48dc-a289-28989134aff9 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:21.967397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c776924c-a46d-48dc-a289-28989134aff9 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:21.968910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c776924c-a46d-48dc-a289-28989134aff9 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:21.970041 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c776924c-a46d-48dc-a289-28989134aff9 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1743 microversion: 2.20 time: 0.162148 Aug 17 08:44:21.970603 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 315/627] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:21 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:22.992894 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-561afe4e-f744-47d0-8b8a-57c6c6519993 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:22.993488 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-561afe4e-f744-47d0-8b8a-57c6c6519993 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:23.000470 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-561afe4e-f744-47d0-8b8a-57c6c6519993 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:23.000940 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-561afe4e-f744-47d0-8b8a-57c6c6519993 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:23.001686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-561afe4e-f744-47d0-8b8a-57c6c6519993 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:23.002448 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-561afe4e-f744-47d0-8b8a-57c6c6519993 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:23.002899 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-561afe4e-f744-47d0-8b8a-57c6c6519993 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:23.003310 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-561afe4e-f744-47d0-8b8a-57c6c6519993 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:23.007141 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:44:23.133416 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-561afe4e-f744-47d0-8b8a-57c6c6519993 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:23.141237 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-561afe4e-f744-47d0-8b8a-57c6c6519993 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:23.142745 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-561afe4e-f744-47d0-8b8a-57c6c6519993 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:23.143910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-561afe4e-f744-47d0-8b8a-57c6c6519993 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1743 microversion: 2.20 time: 0.154819 Aug 17 08:44:23.144469 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 313/628] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:22 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:23.577560 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-f20a004c-6a50-4b9c-b173-172ae04062ce req-f09d8ce4-552a-4795-9f9b-3435f86447dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e06cf4-bb49-4d51-93c1-3147069bd032", "name": "network-vif-plugged", "status": "completed", "tag": "bc2b2be5-4c28-489f-8bda-05bbb62b4e19"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:44:23.589234 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-f20a004c-6a50-4b9c-b173-172ae04062ce req-f09d8ce4-552a-4795-9f9b-3435f86447dd service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:23.590282 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-f20a004c-6a50-4b9c-b173-172ae04062ce req-f09d8ce4-552a-4795-9f9b-3435f86447dd service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:23.590726 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-f20a004c-6a50-4b9c-b173-172ae04062ce req-f09d8ce4-552a-4795-9f9b-3435f86447dd service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:23.602263 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-f20a004c-6a50-4b9c-b173-172ae04062ce req-f09d8ce4-552a-4795-9f9b-3435f86447dd service nova] Creating event network-vif-plugged:bc2b2be5-4c28-489f-8bda-05bbb62b4e19 for instance 42e06cf4-bb49-4d51-93c1-3147069bd032 on hv-cinder-85331 Aug 17 08:44:23.608109 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-f20a004c-6a50-4b9c-b173-172ae04062ce req-f09d8ce4-552a-4795-9f9b-3435f86447dd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034115 Aug 17 08:44:23.608931 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 316/629] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:44:24.166381 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0f87af83-ea35-4d58-a11f-872eb0d2af37 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:24.166982 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0f87af83-ea35-4d58-a11f-872eb0d2af37 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:24.173419 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0f87af83-ea35-4d58-a11f-872eb0d2af37 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:24.173888 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0f87af83-ea35-4d58-a11f-872eb0d2af37 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:24.174311 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0f87af83-ea35-4d58-a11f-872eb0d2af37 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:24.175008 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0f87af83-ea35-4d58-a11f-872eb0d2af37 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:24.175452 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0f87af83-ea35-4d58-a11f-872eb0d2af37 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:24.175892 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0f87af83-ea35-4d58-a11f-872eb0d2af37 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:24.307202 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0f87af83-ea35-4d58-a11f-872eb0d2af37 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:24.319140 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0f87af83-ea35-4d58-a11f-872eb0d2af37 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:24.320660 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0f87af83-ea35-4d58-a11f-872eb0d2af37 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:24.321799 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0f87af83-ea35-4d58-a11f-872eb0d2af37 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1738 microversion: 2.20 time: 0.159309 Aug 17 08:44:24.322358 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 314/630] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:24 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:25.349695 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-373c621e-52c5-4007-ab81-b022e5963828 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:25.350982 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-373c621e-52c5-4007-ab81-b022e5963828 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:25.359664 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-373c621e-52c5-4007-ab81-b022e5963828 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:25.360463 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-373c621e-52c5-4007-ab81-b022e5963828 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:25.360903 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-373c621e-52c5-4007-ab81-b022e5963828 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:25.361596 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-373c621e-52c5-4007-ab81-b022e5963828 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:25.362211 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-373c621e-52c5-4007-ab81-b022e5963828 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:25.362799 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-373c621e-52c5-4007-ab81-b022e5963828 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:25.516338 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-373c621e-52c5-4007-ab81-b022e5963828 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:25.527317 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-373c621e-52c5-4007-ab81-b022e5963828 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:25.529680 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-373c621e-52c5-4007-ab81-b022e5963828 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:25.530838 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-373c621e-52c5-4007-ab81-b022e5963828 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1738 microversion: 2.20 time: 0.186202 Aug 17 08:44:25.531393 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 317/631] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:25 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:26.553959 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1961c36f-9eb1-4d98-b83c-da742e016161 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:26.554586 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1961c36f-9eb1-4d98-b83c-da742e016161 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:26.562078 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1961c36f-9eb1-4d98-b83c-da742e016161 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:26.562664 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1961c36f-9eb1-4d98-b83c-da742e016161 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:26.563165 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1961c36f-9eb1-4d98-b83c-da742e016161 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:26.563979 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1961c36f-9eb1-4d98-b83c-da742e016161 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:26.564482 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1961c36f-9eb1-4d98-b83c-da742e016161 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:26.564962 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1961c36f-9eb1-4d98-b83c-da742e016161 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:26.983405 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1961c36f-9eb1-4d98-b83c-da742e016161 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:26.992188 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1961c36f-9eb1-4d98-b83c-da742e016161 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:26.993709 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1961c36f-9eb1-4d98-b83c-da742e016161 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:26.994893 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1961c36f-9eb1-4d98-b83c-da742e016161 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1738 microversion: 2.20 time: 0.445022 Aug 17 08:44:26.995452 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 315/632] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:26 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1738 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:28.018146 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1c833d8e-80c0-4081-8065-6476044c6b34 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:28.018931 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1c833d8e-80c0-4081-8065-6476044c6b34 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:28.025950 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1c833d8e-80c0-4081-8065-6476044c6b34 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:28.026657 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1c833d8e-80c0-4081-8065-6476044c6b34 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:28.027337 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1c833d8e-80c0-4081-8065-6476044c6b34 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:28.028260 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1c833d8e-80c0-4081-8065-6476044c6b34 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:28.028920 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1c833d8e-80c0-4081-8065-6476044c6b34 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:28.029552 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1c833d8e-80c0-4081-8065-6476044c6b34 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:28.175849 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-1c833d8e-80c0-4081-8065-6476044c6b34 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:28.185144 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-1c833d8e-80c0-4081-8065-6476044c6b34 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:28.186637 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-1c833d8e-80c0-4081-8065-6476044c6b34 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:28.187823 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1c833d8e-80c0-4081-8065-6476044c6b34 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1738 microversion: 2.20 time: 0.174076 Aug 17 08:44:28.188604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 318/633] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:28 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:29.211158 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-950b6ddb-b80f-4717-aef2-da85ff2ad718 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:29.211787 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-950b6ddb-b80f-4717-aef2-da85ff2ad718 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:29.220510 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-950b6ddb-b80f-4717-aef2-da85ff2ad718 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:29.221000 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-950b6ddb-b80f-4717-aef2-da85ff2ad718 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:29.221431 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-950b6ddb-b80f-4717-aef2-da85ff2ad718 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:29.222163 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-950b6ddb-b80f-4717-aef2-da85ff2ad718 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:29.222612 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-950b6ddb-b80f-4717-aef2-da85ff2ad718 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:29.223033 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-950b6ddb-b80f-4717-aef2-da85ff2ad718 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:29.360098 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-950b6ddb-b80f-4717-aef2-da85ff2ad718 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:29.368784 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-950b6ddb-b80f-4717-aef2-da85ff2ad718 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:29.370274 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-950b6ddb-b80f-4717-aef2-da85ff2ad718 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:29.371422 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-950b6ddb-b80f-4717-aef2-da85ff2ad718 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1738 microversion: 2.20 time: 0.164219 Aug 17 08:44:29.372335 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 316/634] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:29 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:30.395019 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7bfd407d-2cf0-4515-81a7-0dc0afbfd906 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:30.395748 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7bfd407d-2cf0-4515-81a7-0dc0afbfd906 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:30.402355 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7bfd407d-2cf0-4515-81a7-0dc0afbfd906 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:30.402949 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7bfd407d-2cf0-4515-81a7-0dc0afbfd906 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:30.404006 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7bfd407d-2cf0-4515-81a7-0dc0afbfd906 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:30.405076 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7bfd407d-2cf0-4515-81a7-0dc0afbfd906 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:30.405350 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7bfd407d-2cf0-4515-81a7-0dc0afbfd906 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:30.405817 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7bfd407d-2cf0-4515-81a7-0dc0afbfd906 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:30.552188 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-7bfd407d-2cf0-4515-81a7-0dc0afbfd906 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:30.561836 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-7bfd407d-2cf0-4515-81a7-0dc0afbfd906 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:30.563779 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-7bfd407d-2cf0-4515-81a7-0dc0afbfd906 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:30.564942 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-7bfd407d-2cf0-4515-81a7-0dc0afbfd906 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1738 microversion: 2.20 time: 0.173905 Aug 17 08:44:30.579586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 319/635] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:30 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:31.588951 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-91b7ab5a-be7f-4e7b-a255-b7be0440659a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:31.589611 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-91b7ab5a-be7f-4e7b-a255-b7be0440659a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:31.597283 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-91b7ab5a-be7f-4e7b-a255-b7be0440659a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:31.597772 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-91b7ab5a-be7f-4e7b-a255-b7be0440659a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:31.598210 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-91b7ab5a-be7f-4e7b-a255-b7be0440659a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:31.598916 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-91b7ab5a-be7f-4e7b-a255-b7be0440659a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:31.599359 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-91b7ab5a-be7f-4e7b-a255-b7be0440659a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:31.599802 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-91b7ab5a-be7f-4e7b-a255-b7be0440659a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:31.754681 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-91b7ab5a-be7f-4e7b-a255-b7be0440659a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:31.763574 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-91b7ab5a-be7f-4e7b-a255-b7be0440659a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:31.765245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-91b7ab5a-be7f-4e7b-a255-b7be0440659a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:31.766584 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-91b7ab5a-be7f-4e7b-a255-b7be0440659a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1738 microversion: 2.20 time: 0.181428 Aug 17 08:44:31.767324 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 317/636] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:31 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:32.790083 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-33a1086a-1917-46c9-b41e-c53b103b47aa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:32.791368 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-33a1086a-1917-46c9-b41e-c53b103b47aa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:32.798441 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33a1086a-1917-46c9-b41e-c53b103b47aa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:32.799131 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33a1086a-1917-46c9-b41e-c53b103b47aa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:32.799850 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33a1086a-1917-46c9-b41e-c53b103b47aa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:32.800616 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33a1086a-1917-46c9-b41e-c53b103b47aa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:32.801151 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33a1086a-1917-46c9-b41e-c53b103b47aa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:32.801653 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-33a1086a-1917-46c9-b41e-c53b103b47aa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:32.944259 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-33a1086a-1917-46c9-b41e-c53b103b47aa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:32.953188 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-33a1086a-1917-46c9-b41e-c53b103b47aa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:32.954793 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-33a1086a-1917-46c9-b41e-c53b103b47aa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:32.956064 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-33a1086a-1917-46c9-b41e-c53b103b47aa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1738 microversion: 2.20 time: 0.170065 Aug 17 08:44:32.967740 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 320/637] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:32 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:33.980063 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-cf360ac2-171f-47c6-b38f-6b8dec1f1f46 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:33.980658 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-cf360ac2-171f-47c6-b38f-6b8dec1f1f46 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:33.986848 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cf360ac2-171f-47c6-b38f-6b8dec1f1f46 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:33.987318 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cf360ac2-171f-47c6-b38f-6b8dec1f1f46 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:33.987770 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cf360ac2-171f-47c6-b38f-6b8dec1f1f46 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:33.988450 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cf360ac2-171f-47c6-b38f-6b8dec1f1f46 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:33.988888 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cf360ac2-171f-47c6-b38f-6b8dec1f1f46 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:33.989330 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cf360ac2-171f-47c6-b38f-6b8dec1f1f46 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:34.120456 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-cf360ac2-171f-47c6-b38f-6b8dec1f1f46 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:34.128819 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-cf360ac2-171f-47c6-b38f-6b8dec1f1f46 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:34.130308 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-cf360ac2-171f-47c6-b38f-6b8dec1f1f46 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:34.131470 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-cf360ac2-171f-47c6-b38f-6b8dec1f1f46 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1720 microversion: 2.20 time: 0.155768 Aug 17 08:44:34.132075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 318/638] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:33 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:35.155208 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3d43d628-f081-47d9-aa2c-72c6ea908677 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:35.155877 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3d43d628-f081-47d9-aa2c-72c6ea908677 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:35.161752 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d43d628-f081-47d9-aa2c-72c6ea908677 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:35.162230 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d43d628-f081-47d9-aa2c-72c6ea908677 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:35.162678 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d43d628-f081-47d9-aa2c-72c6ea908677 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:35.163354 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d43d628-f081-47d9-aa2c-72c6ea908677 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:35.163827 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d43d628-f081-47d9-aa2c-72c6ea908677 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:35.164246 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3d43d628-f081-47d9-aa2c-72c6ea908677 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:35.288473 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3d43d628-f081-47d9-aa2c-72c6ea908677 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:35.296258 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3d43d628-f081-47d9-aa2c-72c6ea908677 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:35.297745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3d43d628-f081-47d9-aa2c-72c6ea908677 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:35.298868 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3d43d628-f081-47d9-aa2c-72c6ea908677 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1720 microversion: 2.20 time: 0.148316 Aug 17 08:44:35.299424 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 321/639] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:35 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:36.322684 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-24dabed6-b5da-457d-baf5-8a15d3dfa1ab tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:36.323260 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-24dabed6-b5da-457d-baf5-8a15d3dfa1ab tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:36.330717 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-24dabed6-b5da-457d-baf5-8a15d3dfa1ab tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:36.331193 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-24dabed6-b5da-457d-baf5-8a15d3dfa1ab tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:36.331659 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-24dabed6-b5da-457d-baf5-8a15d3dfa1ab tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:36.332350 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-24dabed6-b5da-457d-baf5-8a15d3dfa1ab tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:36.332793 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-24dabed6-b5da-457d-baf5-8a15d3dfa1ab tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:36.333205 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-24dabed6-b5da-457d-baf5-8a15d3dfa1ab tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:36.483496 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-24dabed6-b5da-457d-baf5-8a15d3dfa1ab tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:36.492980 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-24dabed6-b5da-457d-baf5-8a15d3dfa1ab tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:36.497303 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-24dabed6-b5da-457d-baf5-8a15d3dfa1ab tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:36.498510 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-24dabed6-b5da-457d-baf5-8a15d3dfa1ab tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1723 microversion: 2.20 time: 0.179931 Aug 17 08:44:36.499186 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 319/640] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:36 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:36.522648 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-190c8a28-7c36-41b8-8769-d53e4e5d1aa6 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85510322-b09b-41cd-a6d5-8fcf0b07f194"}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:44:36.525128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-190c8a28-7c36-41b8-8769-d53e4e5d1aa6 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:36.534335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-190c8a28-7c36-41b8-8769-d53e4e5d1aa6 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:36.534864 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-190c8a28-7c36-41b8-8769-d53e4e5d1aa6 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:36.535245 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-190c8a28-7c36-41b8-8769-d53e4e5d1aa6 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:36.535977 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-190c8a28-7c36-41b8-8769-d53e4e5d1aa6 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:36.536417 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-190c8a28-7c36-41b8-8769-d53e4e5d1aa6 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:36.536828 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-190c8a28-7c36-41b8-8769-d53e4e5d1aa6 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:36.804626 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-190c8a28-7c36-41b8-8769-d53e4e5d1aa6 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "POST /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.286083 Aug 17 08:44:36.805237 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 322/641] 10.222.0.15 () {62 vars in 1364 bytes} [Wed Aug 17 08:44:36 2022] POST /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032/os-volume_attachments => generated 188 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 08:44:36.923834 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2490e2f9-63eb-4a3c-91bf-6d7d40265e52 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:44:36.924475 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2490e2f9-63eb-4a3c-91bf-6d7d40265e52 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:36.930349 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2490e2f9-63eb-4a3c-91bf-6d7d40265e52 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:36.930825 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2490e2f9-63eb-4a3c-91bf-6d7d40265e52 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:36.931252 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2490e2f9-63eb-4a3c-91bf-6d7d40265e52 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:36.931957 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2490e2f9-63eb-4a3c-91bf-6d7d40265e52 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:36.932402 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2490e2f9-63eb-4a3c-91bf-6d7d40265e52 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:36.932821 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2490e2f9-63eb-4a3c-91bf-6d7d40265e52 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:36.962567 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2490e2f9-63eb-4a3c-91bf-6d7d40265e52 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127298) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 08:44:37.027394 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2490e2f9-63eb-4a3c-91bf-6d7d40265e52 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "POST /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032/action" status: 202 len: 0 microversion: 2.20 time: 0.107396 Aug 17 08:44:37.028097 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 320/642] 10.222.0.15 () {62 vars in 1319 bytes} [Wed Aug 17 08:44:36 2022] POST /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 08:44:37.036436 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-25fa732c-6048-40cd-9f1d-ee97f4e928f4 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:37.037596 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-25fa732c-6048-40cd-9f1d-ee97f4e928f4 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:37.043939 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-25fa732c-6048-40cd-9f1d-ee97f4e928f4 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:37.044497 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-25fa732c-6048-40cd-9f1d-ee97f4e928f4 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:37.045002 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-25fa732c-6048-40cd-9f1d-ee97f4e928f4 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:37.045732 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-25fa732c-6048-40cd-9f1d-ee97f4e928f4 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:37.046246 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-25fa732c-6048-40cd-9f1d-ee97f4e928f4 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:37.046668 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-25fa732c-6048-40cd-9f1d-ee97f4e928f4 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:37.179044 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-25fa732c-6048-40cd-9f1d-ee97f4e928f4 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:37.189036 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-25fa732c-6048-40cd-9f1d-ee97f4e928f4 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:37.190872 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-25fa732c-6048-40cd-9f1d-ee97f4e928f4 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:37.192264 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-25fa732c-6048-40cd-9f1d-ee97f4e928f4 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1749 microversion: 2.20 time: 0.159692 Aug 17 08:44:37.192930 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 323/643] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:37 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:37.647691 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-f1e241de-5995-483f-aa91-964e61637398 req-4f0a868e-1f8a-4243-829c-7bff4ae839d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e06cf4-bb49-4d51-93c1-3147069bd032", "name": "network-vif-unplugged", "status": "completed", "tag": "bc2b2be5-4c28-489f-8bda-05bbb62b4e19"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:44:37.658192 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-f1e241de-5995-483f-aa91-964e61637398 req-4f0a868e-1f8a-4243-829c-7bff4ae839d9 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:37.658700 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-f1e241de-5995-483f-aa91-964e61637398 req-4f0a868e-1f8a-4243-829c-7bff4ae839d9 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:37.659316 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-f1e241de-5995-483f-aa91-964e61637398 req-4f0a868e-1f8a-4243-829c-7bff4ae839d9 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:37.673586 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.compute.server_external_events [req-f1e241de-5995-483f-aa91-964e61637398 req-4f0a868e-1f8a-4243-829c-7bff4ae839d9 service nova] Unable to find a host for instance 42e06cf4-bb49-4d51-93c1-3147069bd032. Dropping event network-vif-unplugged {{(pid=127298) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 17 08:44:37.674480 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-f1e241de-5995-483f-aa91-964e61637398 req-4f0a868e-1f8a-4243-829c-7bff4ae839d9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030605 Aug 17 08:44:37.675078 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 321/644] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 17 08:44:38.216512 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5f593fce-6320-4164-adcc-7673f6b9092c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:38.217201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-5f593fce-6320-4164-adcc-7673f6b9092c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:38.223622 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5f593fce-6320-4164-adcc-7673f6b9092c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:38.224101 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5f593fce-6320-4164-adcc-7673f6b9092c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:38.224527 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5f593fce-6320-4164-adcc-7673f6b9092c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:38.225210 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5f593fce-6320-4164-adcc-7673f6b9092c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:38.225657 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5f593fce-6320-4164-adcc-7673f6b9092c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:38.226077 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5f593fce-6320-4164-adcc-7673f6b9092c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:38.354983 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-5f593fce-6320-4164-adcc-7673f6b9092c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:38.363335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-5f593fce-6320-4164-adcc-7673f6b9092c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:38.364906 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-5f593fce-6320-4164-adcc-7673f6b9092c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:38.366045 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-5f593fce-6320-4164-adcc-7673f6b9092c tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1751 microversion: 2.20 time: 0.153983 Aug 17 08:44:38.366600 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 324/645] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:38 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:38.647771 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-7c8d1ce9-40df-474c-96f0-46d5e6c5c57e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:38.648290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7c8d1ce9-40df-474c-96f0-46d5e6c5c57e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:38.655091 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7c8d1ce9-40df-474c-96f0-46d5e6c5c57e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:38.655597 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7c8d1ce9-40df-474c-96f0-46d5e6c5c57e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:38.656063 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7c8d1ce9-40df-474c-96f0-46d5e6c5c57e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:38.656696 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7c8d1ce9-40df-474c-96f0-46d5e6c5c57e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:38.657142 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7c8d1ce9-40df-474c-96f0-46d5e6c5c57e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:38.657570 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7c8d1ce9-40df-474c-96f0-46d5e6c5c57e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:38.680952 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-7c8d1ce9-40df-474c-96f0-46d5e6c5c57e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972/ips" status: 200 len: 150 microversion: 2.1 time: 0.037111 Aug 17 08:44:38.681527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 322/646] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 08:44:38 2022] GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:44:39.389553 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-85675a2b-da50-4d32-a339-cc1fac8faf1e tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:39.390145 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-85675a2b-da50-4d32-a339-cc1fac8faf1e tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:39.396329 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-85675a2b-da50-4d32-a339-cc1fac8faf1e tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:39.396807 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-85675a2b-da50-4d32-a339-cc1fac8faf1e tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:39.397230 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-85675a2b-da50-4d32-a339-cc1fac8faf1e tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:39.397904 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-85675a2b-da50-4d32-a339-cc1fac8faf1e tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:39.398346 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-85675a2b-da50-4d32-a339-cc1fac8faf1e tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:39.398762 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-85675a2b-da50-4d32-a339-cc1fac8faf1e tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:39.593689 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-85675a2b-da50-4d32-a339-cc1fac8faf1e tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:39.602445 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-85675a2b-da50-4d32-a339-cc1fac8faf1e tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:39.604074 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-85675a2b-da50-4d32-a339-cc1fac8faf1e tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:39.605234 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-85675a2b-da50-4d32-a339-cc1fac8faf1e tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1807 microversion: 2.20 time: 0.220238 Aug 17 08:44:39.606054 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 325/647] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:39 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1807 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:40.046788 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a1aba5d3-afbe-4b48-b999-2860c9930d47 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4b60026-271a-4507-9bf3-3b12a398c955"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:44:40.049074 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a1aba5d3-afbe-4b48-b999-2860c9930d47 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:40.055279 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a1aba5d3-afbe-4b48-b999-2860c9930d47 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:40.055781 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a1aba5d3-afbe-4b48-b999-2860c9930d47 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:40.056204 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a1aba5d3-afbe-4b48-b999-2860c9930d47 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:40.056876 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a1aba5d3-afbe-4b48-b999-2860c9930d47 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:40.057316 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a1aba5d3-afbe-4b48-b999-2860c9930d47 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:40.057724 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a1aba5d3-afbe-4b48-b999-2860c9930d47 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:40.628798 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3cc8a6ce-be3c-40fa-8bc2-33af354eb1fa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:40.629372 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3cc8a6ce-be3c-40fa-8bc2-33af354eb1fa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:40.635766 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3cc8a6ce-be3c-40fa-8bc2-33af354eb1fa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:40.636358 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3cc8a6ce-be3c-40fa-8bc2-33af354eb1fa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:40.636870 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3cc8a6ce-be3c-40fa-8bc2-33af354eb1fa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:40.638230 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3cc8a6ce-be3c-40fa-8bc2-33af354eb1fa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:40.638684 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3cc8a6ce-be3c-40fa-8bc2-33af354eb1fa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:40.639115 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3cc8a6ce-be3c-40fa-8bc2-33af354eb1fa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:40.781121 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3cc8a6ce-be3c-40fa-8bc2-33af354eb1fa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:40.790409 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3cc8a6ce-be3c-40fa-8bc2-33af354eb1fa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:40.791945 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3cc8a6ce-be3c-40fa-8bc2-33af354eb1fa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:40.793097 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3cc8a6ce-be3c-40fa-8bc2-33af354eb1fa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1807 microversion: 2.20 time: 0.168678 Aug 17 08:44:40.795120 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 326/648] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:40 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 08:44:41.817657 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0518aed1-dd92-436d-ac1f-732898d7de91 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:41.818500 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0518aed1-dd92-436d-ac1f-732898d7de91 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:41.826380 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0518aed1-dd92-436d-ac1f-732898d7de91 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:41.826862 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0518aed1-dd92-436d-ac1f-732898d7de91 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:41.827295 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0518aed1-dd92-436d-ac1f-732898d7de91 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:41.828328 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0518aed1-dd92-436d-ac1f-732898d7de91 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:41.828812 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0518aed1-dd92-436d-ac1f-732898d7de91 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:41.829235 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0518aed1-dd92-436d-ac1f-732898d7de91 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:41.967624 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0518aed1-dd92-436d-ac1f-732898d7de91 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:41.976415 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0518aed1-dd92-436d-ac1f-732898d7de91 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:41.977983 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-0518aed1-dd92-436d-ac1f-732898d7de91 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:41.979145 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0518aed1-dd92-436d-ac1f-732898d7de91 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1807 microversion: 2.20 time: 0.165396 Aug 17 08:44:41.980125 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 327/649] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:41 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:43.002743 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d6481ad5-812d-409b-a08b-eb569a931ccc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:43.003458 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d6481ad5-812d-409b-a08b-eb569a931ccc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:43.010811 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d6481ad5-812d-409b-a08b-eb569a931ccc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:43.011570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d6481ad5-812d-409b-a08b-eb569a931ccc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:43.012630 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d6481ad5-812d-409b-a08b-eb569a931ccc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:43.013337 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d6481ad5-812d-409b-a08b-eb569a931ccc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:43.013793 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d6481ad5-812d-409b-a08b-eb569a931ccc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:43.014217 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d6481ad5-812d-409b-a08b-eb569a931ccc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:43.152214 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d6481ad5-812d-409b-a08b-eb569a931ccc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:43.162847 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d6481ad5-812d-409b-a08b-eb569a931ccc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:43.164645 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d6481ad5-812d-409b-a08b-eb569a931ccc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:43.165871 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d6481ad5-812d-409b-a08b-eb569a931ccc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1807 microversion: 2.20 time: 0.167065 Aug 17 08:44:43.166521 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 328/650] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:42 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 08:44:44.189371 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8fa8d2f6-ea18-4664-a021-68c7e8c33993 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:44.190099 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8fa8d2f6-ea18-4664-a021-68c7e8c33993 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:44.196383 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8fa8d2f6-ea18-4664-a021-68c7e8c33993 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:44.196852 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8fa8d2f6-ea18-4664-a021-68c7e8c33993 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:44.197278 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8fa8d2f6-ea18-4664-a021-68c7e8c33993 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:44.197956 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8fa8d2f6-ea18-4664-a021-68c7e8c33993 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:44.198400 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8fa8d2f6-ea18-4664-a021-68c7e8c33993 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:44.198811 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8fa8d2f6-ea18-4664-a021-68c7e8c33993 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:44.337920 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8fa8d2f6-ea18-4664-a021-68c7e8c33993 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:44.340866 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:44:44.348483 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8fa8d2f6-ea18-4664-a021-68c7e8c33993 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:44.349974 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8fa8d2f6-ea18-4664-a021-68c7e8c33993 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:44.351127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8fa8d2f6-ea18-4664-a021-68c7e8c33993 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1807 microversion: 2.20 time: 0.165723 Aug 17 08:44:44.352081 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 329/651] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:44 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 08:44:45.375922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-602ab0d6-1816-4fdf-b047-8e62217cee3b tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:45.376726 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-602ab0d6-1816-4fdf-b047-8e62217cee3b tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:45.383576 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-602ab0d6-1816-4fdf-b047-8e62217cee3b tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:45.384186 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-602ab0d6-1816-4fdf-b047-8e62217cee3b tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:45.384613 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-602ab0d6-1816-4fdf-b047-8e62217cee3b tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:45.385301 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-602ab0d6-1816-4fdf-b047-8e62217cee3b tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:45.385745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-602ab0d6-1816-4fdf-b047-8e62217cee3b tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:45.386156 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-602ab0d6-1816-4fdf-b047-8e62217cee3b tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:45.541196 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-602ab0d6-1816-4fdf-b047-8e62217cee3b tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:45.549641 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-602ab0d6-1816-4fdf-b047-8e62217cee3b tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:45.551120 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-602ab0d6-1816-4fdf-b047-8e62217cee3b tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:45.552285 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-602ab0d6-1816-4fdf-b047-8e62217cee3b tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1807 microversion: 2.20 time: 0.181573 Aug 17 08:44:45.553159 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 330/652] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:45 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 08:44:46.575966 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-875665ba-9402-4c08-a889-044362567426 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:46.576667 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-875665ba-9402-4c08-a889-044362567426 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:46.589238 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-875665ba-9402-4c08-a889-044362567426 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:46.589238 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-875665ba-9402-4c08-a889-044362567426 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:46.589238 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-875665ba-9402-4c08-a889-044362567426 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:46.589238 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-875665ba-9402-4c08-a889-044362567426 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:46.590234 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-875665ba-9402-4c08-a889-044362567426 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:46.590234 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-875665ba-9402-4c08-a889-044362567426 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:46.740634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-875665ba-9402-4c08-a889-044362567426 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:46.750208 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-875665ba-9402-4c08-a889-044362567426 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:46.751643 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-875665ba-9402-4c08-a889-044362567426 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:46.752778 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-875665ba-9402-4c08-a889-044362567426 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1807 microversion: 2.20 time: 0.181220 Aug 17 08:44:46.753329 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 331/653] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:46 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 08:44:47.779898 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-becbf731-99fa-4477-b356-0c7bbcaea244 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:47.780669 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-becbf731-99fa-4477-b356-0c7bbcaea244 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:47.788676 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-becbf731-99fa-4477-b356-0c7bbcaea244 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:47.789168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-becbf731-99fa-4477-b356-0c7bbcaea244 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:47.789694 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-becbf731-99fa-4477-b356-0c7bbcaea244 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:47.790374 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-becbf731-99fa-4477-b356-0c7bbcaea244 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:47.790826 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-becbf731-99fa-4477-b356-0c7bbcaea244 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:47.791246 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-becbf731-99fa-4477-b356-0c7bbcaea244 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:47.922996 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-becbf731-99fa-4477-b356-0c7bbcaea244 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:47.931505 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-becbf731-99fa-4477-b356-0c7bbcaea244 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:47.933034 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-becbf731-99fa-4477-b356-0c7bbcaea244 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:47.934764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-becbf731-99fa-4477-b356-0c7bbcaea244 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1807 microversion: 2.20 time: 0.161101 Aug 17 08:44:47.935326 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 332/654] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:47 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:48.052663 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a1aba5d3-afbe-4b48-b999-2860c9930d47 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "POST /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.010185 Aug 17 08:44:48.053254 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 323/655] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 08:44:40 2022] POST /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972/os-volume_attachments => generated 194 bytes in 8012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:44:48.958387 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b5fe9b5c-1a94-4d7b-89f8-9aab5e245da2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:48.958943 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b5fe9b5c-1a94-4d7b-89f8-9aab5e245da2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:48.965534 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b5fe9b5c-1a94-4d7b-89f8-9aab5e245da2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:48.966527 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b5fe9b5c-1a94-4d7b-89f8-9aab5e245da2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:48.967153 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b5fe9b5c-1a94-4d7b-89f8-9aab5e245da2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:48.967865 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b5fe9b5c-1a94-4d7b-89f8-9aab5e245da2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:48.968318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b5fe9b5c-1a94-4d7b-89f8-9aab5e245da2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:48.968737 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b5fe9b5c-1a94-4d7b-89f8-9aab5e245da2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:49.149237 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b5fe9b5c-1a94-4d7b-89f8-9aab5e245da2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:49.157890 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b5fe9b5c-1a94-4d7b-89f8-9aab5e245da2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:49.159994 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b5fe9b5c-1a94-4d7b-89f8-9aab5e245da2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:49.161477 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b5fe9b5c-1a94-4d7b-89f8-9aab5e245da2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1807 microversion: 2.20 time: 0.207106 Aug 17 08:44:49.162032 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 333/656] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:48 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1807 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:49.823728 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-fdae6789-d156-4973-b4f3-54989a2bd535 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:49.824310 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-fdae6789-d156-4973-b4f3-54989a2bd535 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:49.826775 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-ddb55814-d80f-4acf-b0ce-c659425720be req-5e073394-481e-4f26-a8be-4cb260282364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe1b2a32-cde6-43da-885e-78a42a55a7f1", "tag": "26fa0a6d-8a86-40e7-a48f-d1b7d96cfcfb"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:44:49.837447 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fdae6789-d156-4973-b4f3-54989a2bd535 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:49.838173 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fdae6789-d156-4973-b4f3-54989a2bd535 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:49.838932 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fdae6789-d156-4973-b4f3-54989a2bd535 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:49.839659 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fdae6789-d156-4973-b4f3-54989a2bd535 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:49.840109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fdae6789-d156-4973-b4f3-54989a2bd535 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:49.840525 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fdae6789-d156-4973-b4f3-54989a2bd535 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:49.853201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-ddb55814-d80f-4acf-b0ce-c659425720be req-5e073394-481e-4f26-a8be-4cb260282364 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:49.857405 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-ddb55814-d80f-4acf-b0ce-c659425720be req-5e073394-481e-4f26-a8be-4cb260282364 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:49.857977 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-ddb55814-d80f-4acf-b0ce-c659425720be req-5e073394-481e-4f26-a8be-4cb260282364 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:49.866322 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-fdae6789-d156-4973-b4f3-54989a2bd535 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 08:44:49.869704 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-ddb55814-d80f-4acf-b0ce-c659425720be req-5e073394-481e-4f26-a8be-4cb260282364 service nova] Creating event network-changed:26fa0a6d-8a86-40e7-a48f-d1b7d96cfcfb for instance fe1b2a32-cde6-43da-885e-78a42a55a7f1 on hv-cinder-85331 Aug 17 08:44:49.874796 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-ddb55814-d80f-4acf-b0ce-c659425720be req-5e073394-481e-4f26-a8be-4cb260282364 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052380 Aug 17 08:44:49.875472 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 334/657] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:44:49.945814 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-fdae6789-d156-4973-b4f3-54989a2bd535 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "DELETE /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 204 len: 0 microversion: 2.1 time: 0.125854 Aug 17 08:44:49.948500 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 324/658] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:44:49 2022] DELETE /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 08:44:49.956979 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-93a3f9c6-c08c-4c0f-8184-0096b401fe46 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:49.957671 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-93a3f9c6-c08c-4c0f-8184-0096b401fe46 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:49.965119 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-93a3f9c6-c08c-4c0f-8184-0096b401fe46 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:49.966843 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-93a3f9c6-c08c-4c0f-8184-0096b401fe46 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:49.967453 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-93a3f9c6-c08c-4c0f-8184-0096b401fe46 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:49.968191 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-93a3f9c6-c08c-4c0f-8184-0096b401fe46 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:49.968645 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-93a3f9c6-c08c-4c0f-8184-0096b401fe46 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:49.969252 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-93a3f9c6-c08c-4c0f-8184-0096b401fe46 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:50.101183 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-93a3f9c6-c08c-4c0f-8184-0096b401fe46 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:50.109873 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-93a3f9c6-c08c-4c0f-8184-0096b401fe46 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1569 microversion: 2.1 time: 0.157454 Aug 17 08:44:50.110454 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 335/659] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:44:49 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:44:50.185638 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a8718ab1-25f1-44dc-a840-0a46f39b21e2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:50.186545 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a8718ab1-25f1-44dc-a840-0a46f39b21e2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:50.193083 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a8718ab1-25f1-44dc-a840-0a46f39b21e2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:50.193684 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a8718ab1-25f1-44dc-a840-0a46f39b21e2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:50.194240 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a8718ab1-25f1-44dc-a840-0a46f39b21e2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:50.195026 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a8718ab1-25f1-44dc-a840-0a46f39b21e2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:50.195605 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a8718ab1-25f1-44dc-a840-0a46f39b21e2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:50.196149 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a8718ab1-25f1-44dc-a840-0a46f39b21e2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:50.330531 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a8718ab1-25f1-44dc-a840-0a46f39b21e2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:50.339078 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a8718ab1-25f1-44dc-a840-0a46f39b21e2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:50.340632 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a8718ab1-25f1-44dc-a840-0a46f39b21e2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:50.341780 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a8718ab1-25f1-44dc-a840-0a46f39b21e2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1807 microversion: 2.20 time: 0.160939 Aug 17 08:44:50.342339 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 325/660] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:50 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 08:44:51.131776 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-9cc8e214-6a61-4c1e-b626-848b6ed6d663 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:51.132384 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-9cc8e214-6a61-4c1e-b626-848b6ed6d663 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:51.139422 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9cc8e214-6a61-4c1e-b626-848b6ed6d663 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:51.139939 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9cc8e214-6a61-4c1e-b626-848b6ed6d663 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:51.140375 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9cc8e214-6a61-4c1e-b626-848b6ed6d663 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:51.141064 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9cc8e214-6a61-4c1e-b626-848b6ed6d663 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:51.141516 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9cc8e214-6a61-4c1e-b626-848b6ed6d663 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:51.141938 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9cc8e214-6a61-4c1e-b626-848b6ed6d663 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:51.310924 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-9cc8e214-6a61-4c1e-b626-848b6ed6d663 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:51.318531 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-9cc8e214-6a61-4c1e-b626-848b6ed6d663 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1569 microversion: 2.1 time: 0.190610 Aug 17 08:44:51.319193 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 336/661] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:44:51 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:44:51.364282 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-bc729a7d-1751-4126-b9d8-ff81e1b37fdc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:51.364819 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-bc729a7d-1751-4126-b9d8-ff81e1b37fdc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:51.367204 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:44:51.372797 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc729a7d-1751-4126-b9d8-ff81e1b37fdc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:51.373273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc729a7d-1751-4126-b9d8-ff81e1b37fdc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:51.373700 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc729a7d-1751-4126-b9d8-ff81e1b37fdc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:51.374377 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc729a7d-1751-4126-b9d8-ff81e1b37fdc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:51.374825 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc729a7d-1751-4126-b9d8-ff81e1b37fdc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:51.375241 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc729a7d-1751-4126-b9d8-ff81e1b37fdc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:51.506141 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-bc729a7d-1751-4126-b9d8-ff81e1b37fdc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:51.508339 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:44:51.516068 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-bc729a7d-1751-4126-b9d8-ff81e1b37fdc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:51.518190 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-bc729a7d-1751-4126-b9d8-ff81e1b37fdc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:51.519336 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-bc729a7d-1751-4126-b9d8-ff81e1b37fdc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1807 microversion: 2.20 time: 0.159029 Aug 17 08:44:51.519925 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 326/662] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:51 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:52.067336 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-a7db6a06-a4a3-48cc-969a-63aba7889f4d req-790e22b5-8db7-40a7-b41b-fe1839909d59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe1b2a32-cde6-43da-885e-78a42a55a7f1", "name": "network-vif-deleted", "tag": "26fa0a6d-8a86-40e7-a48f-d1b7d96cfcfb"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:44:52.072251 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=44 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:44:52.078916 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-a7db6a06-a4a3-48cc-969a-63aba7889f4d req-790e22b5-8db7-40a7-b41b-fe1839909d59 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:52.079417 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-a7db6a06-a4a3-48cc-969a-63aba7889f4d req-790e22b5-8db7-40a7-b41b-fe1839909d59 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:52.079923 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-a7db6a06-a4a3-48cc-969a-63aba7889f4d req-790e22b5-8db7-40a7-b41b-fe1839909d59 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:52.093379 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-a7db6a06-a4a3-48cc-969a-63aba7889f4d req-790e22b5-8db7-40a7-b41b-fe1839909d59 service nova] Creating event network-vif-deleted:26fa0a6d-8a86-40e7-a48f-d1b7d96cfcfb for instance fe1b2a32-cde6-43da-885e-78a42a55a7f1 on hv-cinder-85331 Aug 17 08:44:52.098052 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-a7db6a06-a4a3-48cc-969a-63aba7889f4d req-790e22b5-8db7-40a7-b41b-fe1839909d59 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034393 Aug 17 08:44:52.098640 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 337/663] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:44:52.351223 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-92871f53-3315-482c-ad77-d2594d6f2608 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:52.356896 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-92871f53-3315-482c-ad77-d2594d6f2608 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:52.414355 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-92871f53-3315-482c-ad77-d2594d6f2608 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:52.425505 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-92871f53-3315-482c-ad77-d2594d6f2608 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:52.425505 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-92871f53-3315-482c-ad77-d2594d6f2608 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:52.425505 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-92871f53-3315-482c-ad77-d2594d6f2608 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:52.425505 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-92871f53-3315-482c-ad77-d2594d6f2608 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:52.426326 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-92871f53-3315-482c-ad77-d2594d6f2608 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:52.492815 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-92871f53-3315-482c-ad77-d2594d6f2608 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ea9b3af8884377888513b608669afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ccc5a670c049eda6e6f5b97b73ebec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:52.501415 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-92871f53-3315-482c-ad77-d2594d6f2608 tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 200 len: 1220 microversion: 2.1 time: 0.164537 Aug 17 08:44:52.502352 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 327/664] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:44:52 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 1220 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:44:52.543591 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d2ad7d0b-0806-412a-a857-6a28ec6ca7ce tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:52.544848 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d2ad7d0b-0806-412a-a857-6a28ec6ca7ce tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:52.550837 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2ad7d0b-0806-412a-a857-6a28ec6ca7ce tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:52.551325 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2ad7d0b-0806-412a-a857-6a28ec6ca7ce tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:52.551771 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2ad7d0b-0806-412a-a857-6a28ec6ca7ce tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:52.552482 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2ad7d0b-0806-412a-a857-6a28ec6ca7ce tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:52.552904 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2ad7d0b-0806-412a-a857-6a28ec6ca7ce tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:52.553324 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2ad7d0b-0806-412a-a857-6a28ec6ca7ce tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:52.690483 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d2ad7d0b-0806-412a-a857-6a28ec6ca7ce tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:52.698846 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d2ad7d0b-0806-412a-a857-6a28ec6ca7ce tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:52.701072 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d2ad7d0b-0806-412a-a857-6a28ec6ca7ce tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:52.702568 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d2ad7d0b-0806-412a-a857-6a28ec6ca7ce tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1807 microversion: 2.20 time: 0.163662 Aug 17 08:44:52.703127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 338/665] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:52 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:53.522233 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-936799cb-e4db-4d96-9433-c0bd9b62941a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:53.522834 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-936799cb-e4db-4d96-9433-c0bd9b62941a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] [instance: fe1b2a32-cde6-43da-885e-78a42a55a7f1] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:53.529245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-936799cb-e4db-4d96-9433-c0bd9b62941a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:53.529722 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-936799cb-e4db-4d96-9433-c0bd9b62941a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:53.530147 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-936799cb-e4db-4d96-9433-c0bd9b62941a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:53.530830 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-936799cb-e4db-4d96-9433-c0bd9b62941a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:53.531273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-936799cb-e4db-4d96-9433-c0bd9b62941a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:53.531733 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-936799cb-e4db-4d96-9433-c0bd9b62941a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:53.544666 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-936799cb-e4db-4d96-9433-c0bd9b62941a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] HTTP exception thrown: Instance fe1b2a32-cde6-43da-885e-78a42a55a7f1 could not be found. Aug 17 08:44:53.546273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-936799cb-e4db-4d96-9433-c0bd9b62941a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Request method failure captured: Aug 17 08:44:53.546273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 HTTP/1.1 Aug 17 08:44:53.546273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:44:53.546273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:44:53.546273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:44:53.546273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:44:53.546273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:44:53.546273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:44:53.546273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:44:53.546273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:44:53.546273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_Kk9onSeYdV7vnIculgipXWXd7kpZMvb4v1-NG5GQfMtpXCR5FlG8DcxsyP_sgxQx-JG9G28Mksydp8bc9j281EMN6Cx1mdKE1qLORZQD3xL1e_7WCxbx0c3KZPP7NxsEGmBa-uvW-ryAyo7AmXrchR74ty-O1YYNZoRJ1mZDxmRaQ4 Aug 17 08:44:53.546273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:44:53.546273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:44:53.546273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:44:53.546273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:44:53.546273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:44:53.546273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:44:53.546273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: 08ccc5a670c049eda6e6f5b97b73ebec Aug 17 08:44:53.546273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-TestShelveInstance-2106485327 Aug 17 08:44:53.546273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:44:53.546273 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:44:53.547986 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/08ccc5a670c049eda6e6f5b97b73ebec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/08ccc5a670c049eda6e6f5b97b73ebec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/08ccc5a670c049eda6e6f5b97b73ebec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_08ccc5a670c049eda6e6f5b97b73ebec", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:44:53.547986 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-TestShelveInstance-2106485327 Aug 17 08:44:53.547986 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 08ccc5a670c049eda6e6f5b97b73ebec Aug 17 08:44:53.547986 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-TestShelveInstance-2106485327 Aug 17 08:44:53.547986 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-TestShelveInstance-2106485327-project Aug 17 08:44:53.547986 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:44:53.547986 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:44:53.547986 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: 73ea9b3af8884377888513b608669afa Aug 17 08:44:53.547986 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-TestShelveInstance-2106485327-project Aug 17 08:44:53.547986 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:44:53.547986 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Instance fe1b2a32-cde6-43da-885e-78a42a55a7f1 could not be found. Aug 17 08:44:53.547986 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'id': 'fe1b2a32-cde6-43da-885e-78a42a55a7f1'} Aug 17 08:44:53.548906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:44:53.548906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:44:53.548906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:44:53.548906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:44:53.548906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:44:53.548906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:44:53.548906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:44:53.548906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:44:53.548906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:44:53.548906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:44:53.548906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe1b2a32-cde6-43da-885e-78a42a55a7f1 could not be found. Aug 17 08:44:53.548906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:44:53.548906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:44:53.548906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:44:53.548906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:44:53.548906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:44:53.548906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:44:53.548906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:44:53.548906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:44:53.548906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:44:53.550529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:44:53.550529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:44:53.550529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:44:53.550529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:44:53.550529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:44:53.550529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:44:53.550529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:44:53.550529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe1b2a32-cde6-43da-885e-78a42a55a7f1 could not be found. Aug 17 08:44:53.550529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:44:53.550529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:44:53.550529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:44:53.550529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:44:53.550529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:44:53.550529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:44:53.550529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:44:53.550529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:44:53.550529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe1b2a32-cde6-43da-885e-78a42a55a7f1 could not be found. Aug 17 08:44:53.550529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:44:53.552054 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-936799cb-e4db-4d96-9433-c0bd9b62941a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Returning 404 to user: Instance fe1b2a32-cde6-43da-885e-78a42a55a7f1 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:44:53.552054 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-936799cb-e4db-4d96-9433-c0bd9b62941a tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1" status: 404 len: 111 microversion: 2.1 time: 0.029289 Aug 17 08:44:53.552054 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 328/666] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:44:53 2022] GET /compute/v2.1/servers/fe1b2a32-cde6-43da-885e-78a42a55a7f1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:44:53.706479 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-96a64be8-183d-4921-8027-39a2df2af0ba tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] Calling method '.version_select at 0x7f3f8532c040>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:53.725695 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-767bebe2-4eb8-46b9-baac-646f8b5019e8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:53.726783 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-767bebe2-4eb8-46b9-baac-646f8b5019e8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:53.731018 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-96a64be8-183d-4921-8027-39a2df2af0ba tempest-TestShelveInstance-2106485327 tempest-TestShelveInstance-2106485327-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1137111819" status: 202 len: 0 microversion: 2.1 time: 0.028694 Aug 17 08:44:53.731981 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 339/667] 10.222.0.15 () {58 vars in 1254 bytes} [Wed Aug 17 08:44:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1137111819 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:44:53.736393 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-767bebe2-4eb8-46b9-baac-646f8b5019e8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:53.737066 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-767bebe2-4eb8-46b9-baac-646f8b5019e8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:53.737497 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-767bebe2-4eb8-46b9-baac-646f8b5019e8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:53.738215 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-767bebe2-4eb8-46b9-baac-646f8b5019e8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:53.738659 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-767bebe2-4eb8-46b9-baac-646f8b5019e8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:53.739071 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-767bebe2-4eb8-46b9-baac-646f8b5019e8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:53.954755 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-767bebe2-4eb8-46b9-baac-646f8b5019e8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:53.963090 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-767bebe2-4eb8-46b9-baac-646f8b5019e8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:53.964616 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-767bebe2-4eb8-46b9-baac-646f8b5019e8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:53.966327 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-767bebe2-4eb8-46b9-baac-646f8b5019e8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1807 microversion: 2.20 time: 0.244264 Aug 17 08:44:53.966885 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 329/668] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:53 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1807 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 08:44:54.989329 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-fa4c381e-8ac2-4c9b-8ab1-6885bfda12b0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:54.989865 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fa4c381e-8ac2-4c9b-8ab1-6885bfda12b0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:54.996572 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fa4c381e-8ac2-4c9b-8ab1-6885bfda12b0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:54.997037 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fa4c381e-8ac2-4c9b-8ab1-6885bfda12b0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:54.997471 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fa4c381e-8ac2-4c9b-8ab1-6885bfda12b0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:54.998795 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fa4c381e-8ac2-4c9b-8ab1-6885bfda12b0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:54.999251 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fa4c381e-8ac2-4c9b-8ab1-6885bfda12b0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:54.999701 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fa4c381e-8ac2-4c9b-8ab1-6885bfda12b0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:55.132946 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-fa4c381e-8ac2-4c9b-8ab1-6885bfda12b0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:55.142052 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-fa4c381e-8ac2-4c9b-8ab1-6885bfda12b0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:55.143579 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-fa4c381e-8ac2-4c9b-8ab1-6885bfda12b0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:55.144789 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-fa4c381e-8ac2-4c9b-8ab1-6885bfda12b0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1807 microversion: 2.20 time: 0.159528 Aug 17 08:44:55.145353 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 340/669] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:54 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:55.662902 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-35cd7cd1-933c-4ff1-8afa-5bd86eaf11f7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Action: 'create', calling method: .version_select at 0x7f3f852255e0>, body: {"keypair": {"name": "tempest-keypair-455366047", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgt3GTSCAa4btOviFXcXG6bb6n1VtqZ792xcNuf32wBucga9HkByZbrG2wxnw5YrjN4jcOg8VOEiKoTKdvGjwv5jc4+gXs9t6DohZiQi0Q9b1JBmBofYqBOe6vKb71v0Q=="}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:44:55.683988 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-35cd7cd1-933c-4ff1-8afa-5bd86eaf11f7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Getting quotas for project 34b106e46b2c4fb292353a6176c9f699. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:44:55.689618 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-35cd7cd1-933c-4ff1-8afa-5bd86eaf11f7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Getting quotas for user 49114d25c04144269e3eb88448e2c2ee and project 34b106e46b2c4fb292353a6176c9f699. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:44:55.721881 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-35cd7cd1-933c-4ff1-8afa-5bd86eaf11f7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062580 Aug 17 08:44:55.729112 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 330/670] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 08:44:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:44:56.170209 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-151fd83b-05b6-4b1a-9cee-e38fa86d864f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:56.170823 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-151fd83b-05b6-4b1a-9cee-e38fa86d864f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:56.179169 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-151fd83b-05b6-4b1a-9cee-e38fa86d864f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:56.180214 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-151fd83b-05b6-4b1a-9cee-e38fa86d864f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:56.180874 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-151fd83b-05b6-4b1a-9cee-e38fa86d864f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:56.181956 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-151fd83b-05b6-4b1a-9cee-e38fa86d864f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:56.182480 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-151fd83b-05b6-4b1a-9cee-e38fa86d864f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:56.182979 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-151fd83b-05b6-4b1a-9cee-e38fa86d864f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:56.462008 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-151fd83b-05b6-4b1a-9cee-e38fa86d864f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:56.485690 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-151fd83b-05b6-4b1a-9cee-e38fa86d864f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:56.490657 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-151fd83b-05b6-4b1a-9cee-e38fa86d864f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:56.491868 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-151fd83b-05b6-4b1a-9cee-e38fa86d864f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1807 microversion: 2.20 time: 0.326858 Aug 17 08:44:56.492447 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 341/671] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:56 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1807 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:57.225487 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d8d97ace-f323-41c4-a2b5-cc2dfdb01235 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1068468993", "imageRef": "4467450c-a35c-42e3-af85-a13291b0b2aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "57fc802a-439c-414a-9558-62dc475889bd"}], "security_groups": [{"name": "tempest-securitygroup--327433425"}], "key_name": "tempest-keypair-455366047", "user_data": "}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:44:57.333257 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.network.neutron [None req-d8d97ace-f323-41c4-a2b5-cc2dfdb01235 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] validate_networks() for [('57fc802a-439c-414a-9558-62dc475889bd', None, None, None, None, None)] {{(pid=127298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 08:44:57.514976 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b983e25e-0a75-47d7-89bb-255d035f5ea7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:57.515594 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b983e25e-0a75-47d7-89bb-255d035f5ea7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:57.522471 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b983e25e-0a75-47d7-89bb-255d035f5ea7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:57.522957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b983e25e-0a75-47d7-89bb-255d035f5ea7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:57.523386 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b983e25e-0a75-47d7-89bb-255d035f5ea7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:57.524104 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b983e25e-0a75-47d7-89bb-255d035f5ea7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:57.524550 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b983e25e-0a75-47d7-89bb-255d035f5ea7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:57.525148 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b983e25e-0a75-47d7-89bb-255d035f5ea7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:57.745246 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-d8d97ace-f323-41c4-a2b5-cc2dfdb01235 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Flavor limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 08:44:57.746171 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-d8d97ace-f323-41c4-a2b5-cc2dfdb01235 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Image limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 08:44:57.748845 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-d8d97ace-f323-41c4-a2b5-cc2dfdb01235 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Flavor pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 08:44:57.750263 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-d8d97ace-f323-41c4-a2b5-cc2dfdb01235 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Image pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 08:44:57.753036 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-d8d97ace-f323-41c4-a2b5-cc2dfdb01235 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 08:44:57.772389 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d8d97ace-f323-41c4-a2b5-cc2dfdb01235 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:57.773375 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d8d97ace-f323-41c4-a2b5-cc2dfdb01235 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:57.774107 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d8d97ace-f323-41c4-a2b5-cc2dfdb01235 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:57.775382 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d8d97ace-f323-41c4-a2b5-cc2dfdb01235 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:57.776224 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d8d97ace-f323-41c4-a2b5-cc2dfdb01235 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:57.776979 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d8d97ace-f323-41c4-a2b5-cc2dfdb01235 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:57.802031 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b983e25e-0a75-47d7-89bb-255d035f5ea7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:57.808698 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-d8d97ace-f323-41c4-a2b5-cc2dfdb01235 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Getting quotas for project 34b106e46b2c4fb292353a6176c9f699. Resources: {'cores', 'instances', 'ram'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:44:57.818459 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-d8d97ace-f323-41c4-a2b5-cc2dfdb01235 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Getting quotas for user 49114d25c04144269e3eb88448e2c2ee and project 34b106e46b2c4fb292353a6176c9f699. Resources: {'cores', 'instances', 'ram'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:44:57.821853 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b983e25e-0a75-47d7-89bb-255d035f5ea7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:57.823380 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b983e25e-0a75-47d7-89bb-255d035f5ea7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:57.824604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b983e25e-0a75-47d7-89bb-255d035f5ea7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1807 microversion: 2.20 time: 0.314156 Aug 17 08:44:57.826100 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 342/672] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:57 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1807 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 08:44:57.831379 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-6d8ba357-6df7-4b7e-b766-49aa3ab13751 req-cbb6d0ec-b0bd-459f-b586-279dbe72ba05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e06cf4-bb49-4d51-93c1-3147069bd032", "name": "network-vif-plugged", "status": "completed", "tag": "bc2b2be5-4c28-489f-8bda-05bbb62b4e19"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:44:57.841494 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-6d8ba357-6df7-4b7e-b766-49aa3ab13751 req-cbb6d0ec-b0bd-459f-b586-279dbe72ba05 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:57.841974 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-6d8ba357-6df7-4b7e-b766-49aa3ab13751 req-cbb6d0ec-b0bd-459f-b586-279dbe72ba05 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:57.842401 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-6d8ba357-6df7-4b7e-b766-49aa3ab13751 req-cbb6d0ec-b0bd-459f-b586-279dbe72ba05 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:57.863499 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d8d97ace-f323-41c4-a2b5-cc2dfdb01235 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Going to run 1 instances... {{(pid=127298) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 08:44:57.866235 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-6d8ba357-6df7-4b7e-b766-49aa3ab13751 req-cbb6d0ec-b0bd-459f-b586-279dbe72ba05 service nova] Creating event network-vif-plugged:bc2b2be5-4c28-489f-8bda-05bbb62b4e19 for instance 42e06cf4-bb49-4d51-93c1-3147069bd032 on hv-cinder-85331 Aug 17 08:44:57.867373 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d8d97ace-f323-41c4-a2b5-cc2dfdb01235 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: db02d6b1-c272-4c1d-8700-3e096703b1d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4467450c-a35c-42e3-af85-a13291b0b2aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 08:44:57.873395 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-6d8ba357-6df7-4b7e-b766-49aa3ab13751 req-cbb6d0ec-b0bd-459f-b586-279dbe72ba05 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045782 Aug 17 08:44:57.875023 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 343/673] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:44:57.924513 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d8d97ace-f323-41c4-a2b5-cc2dfdb01235 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.704571 Aug 17 08:44:57.925848 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 331/674] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 08:44:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 08:44:57.938307 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-95b80b9d-839f-4de7-9894-7d3ab75eda4b tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:57.939283 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-95b80b9d-839f-4de7-9894-7d3ab75eda4b tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: db02d6b1-c272-4c1d-8700-3e096703b1d6] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:58.175198 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-95b80b9d-839f-4de7-9894-7d3ab75eda4b tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:58.182199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-95b80b9d-839f-4de7-9894-7d3ab75eda4b tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6" status: 200 len: 1241 microversion: 2.1 time: 0.249418 Aug 17 08:44:58.182768 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 344/675] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:44:57 2022] GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6 => generated 1241 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:44:58.869105 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5094e26e-ed99-4950-b7b9-9c2b6ee54319 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:58.869758 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5094e26e-ed99-4950-b7b9-9c2b6ee54319 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:58.876874 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5094e26e-ed99-4950-b7b9-9c2b6ee54319 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:58.877359 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5094e26e-ed99-4950-b7b9-9c2b6ee54319 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:58.877795 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5094e26e-ed99-4950-b7b9-9c2b6ee54319 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:58.878490 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5094e26e-ed99-4950-b7b9-9c2b6ee54319 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:58.878986 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5094e26e-ed99-4950-b7b9-9c2b6ee54319 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:58.879398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5094e26e-ed99-4950-b7b9-9c2b6ee54319 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:59.011015 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5094e26e-ed99-4950-b7b9-9c2b6ee54319 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:59.019596 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5094e26e-ed99-4950-b7b9-9c2b6ee54319 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:59.021104 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5094e26e-ed99-4950-b7b9-9c2b6ee54319 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:59.022252 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5094e26e-ed99-4950-b7b9-9c2b6ee54319 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1807 microversion: 2.20 time: 0.157259 Aug 17 08:44:59.022869 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 332/676] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:44:58 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:44:59.204200 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-cfeb0b82-1695-409b-a21b-0cf1888e532d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:44:59.205020 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-cfeb0b82-1695-409b-a21b-0cf1888e532d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: db02d6b1-c272-4c1d-8700-3e096703b1d6] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:44:59.212442 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cfeb0b82-1695-409b-a21b-0cf1888e532d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:59.213224 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cfeb0b82-1695-409b-a21b-0cf1888e532d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:59.214163 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cfeb0b82-1695-409b-a21b-0cf1888e532d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:59.215166 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cfeb0b82-1695-409b-a21b-0cf1888e532d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:44:59.216733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cfeb0b82-1695-409b-a21b-0cf1888e532d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:44:59.217558 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cfeb0b82-1695-409b-a21b-0cf1888e532d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:44:59.288420 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-cfeb0b82-1695-409b-a21b-0cf1888e532d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:44:59.296729 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-cfeb0b82-1695-409b-a21b-0cf1888e532d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6" status: 200 len: 1293 microversion: 2.1 time: 0.097080 Aug 17 08:44:59.297562 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 345/677] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:44:59 2022] GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6 => generated 1293 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:45:00.047027 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-df020572-d040-42cc-ac0a-6fcb82a0e719 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:00.047861 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-df020572-d040-42cc-ac0a-6fcb82a0e719 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:00.065808 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-df020572-d040-42cc-ac0a-6fcb82a0e719 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:00.066555 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-df020572-d040-42cc-ac0a-6fcb82a0e719 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:00.067177 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-df020572-d040-42cc-ac0a-6fcb82a0e719 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:00.068104 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-df020572-d040-42cc-ac0a-6fcb82a0e719 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:00.069411 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-df020572-d040-42cc-ac0a-6fcb82a0e719 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:00.069839 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-df020572-d040-42cc-ac0a-6fcb82a0e719 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:00.306237 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-df020572-d040-42cc-ac0a-6fcb82a0e719 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:00.317980 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-030d19a4-802b-4f7f-ba35-09c9b9c149b7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:00.318576 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-030d19a4-802b-4f7f-ba35-09c9b9c149b7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: db02d6b1-c272-4c1d-8700-3e096703b1d6] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:00.323483 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-df020572-d040-42cc-ac0a-6fcb82a0e719 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:00.328581 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-df020572-d040-42cc-ac0a-6fcb82a0e719 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:00.330757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-030d19a4-802b-4f7f-ba35-09c9b9c149b7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:00.331301 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-030d19a4-802b-4f7f-ba35-09c9b9c149b7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:00.331710 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-030d19a4-802b-4f7f-ba35-09c9b9c149b7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:00.332735 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-030d19a4-802b-4f7f-ba35-09c9b9c149b7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:00.333146 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-030d19a4-802b-4f7f-ba35-09c9b9c149b7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:00.333261 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-df020572-d040-42cc-ac0a-6fcb82a0e719 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1807 microversion: 2.20 time: 0.289263 Aug 17 08:45:00.333562 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-030d19a4-802b-4f7f-ba35-09c9b9c149b7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:00.334448 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 333/678] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:45:00 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1807 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:45:00.455420 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-030d19a4-802b-4f7f-ba35-09c9b9c149b7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:00.469797 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-030d19a4-802b-4f7f-ba35-09c9b9c149b7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6" status: 200 len: 1299 microversion: 2.1 time: 0.151580 Aug 17 08:45:00.471472 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 346/679] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:00 2022] GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6 => generated 1299 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:45:01.361247 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-97a38cc5-3dc3-4e53-a3b7-19efe9c335d5 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:01.362011 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-97a38cc5-3dc3-4e53-a3b7-19efe9c335d5 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:01.370139 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-97a38cc5-3dc3-4e53-a3b7-19efe9c335d5 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:01.370937 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-97a38cc5-3dc3-4e53-a3b7-19efe9c335d5 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:01.372347 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-97a38cc5-3dc3-4e53-a3b7-19efe9c335d5 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:01.375047 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-97a38cc5-3dc3-4e53-a3b7-19efe9c335d5 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:01.376592 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-97a38cc5-3dc3-4e53-a3b7-19efe9c335d5 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:01.377252 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-97a38cc5-3dc3-4e53-a3b7-19efe9c335d5 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:01.496980 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-04586438-ae86-4d23-9198-b0c40accaf7c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:01.498566 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-04586438-ae86-4d23-9198-b0c40accaf7c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: db02d6b1-c272-4c1d-8700-3e096703b1d6] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:01.505103 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04586438-ae86-4d23-9198-b0c40accaf7c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:01.505933 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04586438-ae86-4d23-9198-b0c40accaf7c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:01.506754 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04586438-ae86-4d23-9198-b0c40accaf7c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:01.507877 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04586438-ae86-4d23-9198-b0c40accaf7c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:01.508810 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04586438-ae86-4d23-9198-b0c40accaf7c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:01.509472 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04586438-ae86-4d23-9198-b0c40accaf7c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:01.625149 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-97a38cc5-3dc3-4e53-a3b7-19efe9c335d5 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:01.637724 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-97a38cc5-3dc3-4e53-a3b7-19efe9c335d5 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:01.640063 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-97a38cc5-3dc3-4e53-a3b7-19efe9c335d5 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:01.642629 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-97a38cc5-3dc3-4e53-a3b7-19efe9c335d5 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1794 microversion: 2.20 time: 0.285586 Aug 17 08:45:01.648495 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 334/680] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:45:01 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1794 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 08:45:01.698764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-04586438-ae86-4d23-9198-b0c40accaf7c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:01.708785 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-04586438-ae86-4d23-9198-b0c40accaf7c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6" status: 200 len: 1366 microversion: 2.1 time: 0.218954 Aug 17 08:45:01.709540 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 347/681] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:01 2022] GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:45:01.973121 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-9dae3606-f674-466f-b40c-75c2a0e31dd8 req-c23efdd0-5826-4480-bf40-9f1c7c852a3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db02d6b1-c272-4c1d-8700-3e096703b1d6", "tag": "a648f16a-8281-46de-a07c-3ad62496891a"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:45:01.984994 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-9dae3606-f674-466f-b40c-75c2a0e31dd8 req-c23efdd0-5826-4480-bf40-9f1c7c852a3e service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:01.985721 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-9dae3606-f674-466f-b40c-75c2a0e31dd8 req-c23efdd0-5826-4480-bf40-9f1c7c852a3e service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:01.986254 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-9dae3606-f674-466f-b40c-75c2a0e31dd8 req-c23efdd0-5826-4480-bf40-9f1c7c852a3e service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:01.999531 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-9dae3606-f674-466f-b40c-75c2a0e31dd8 req-c23efdd0-5826-4480-bf40-9f1c7c852a3e service nova] Creating event network-changed:a648f16a-8281-46de-a07c-3ad62496891a for instance db02d6b1-c272-4c1d-8700-3e096703b1d6 on hv-cinder-85331 Aug 17 08:45:02.005197 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-9dae3606-f674-466f-b40c-75c2a0e31dd8 req-c23efdd0-5826-4480-bf40-9f1c7c852a3e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036348 Aug 17 08:45:02.006092 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 335/682] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:45:02.731929 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b148ea91-c315-438b-bd6c-9b203129e1b6 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:02.732619 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b148ea91-c315-438b-bd6c-9b203129e1b6 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: db02d6b1-c272-4c1d-8700-3e096703b1d6] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:02.738740 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b148ea91-c315-438b-bd6c-9b203129e1b6 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:02.739328 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b148ea91-c315-438b-bd6c-9b203129e1b6 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:02.739864 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b148ea91-c315-438b-bd6c-9b203129e1b6 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:02.740557 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b148ea91-c315-438b-bd6c-9b203129e1b6 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:02.741005 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b148ea91-c315-438b-bd6c-9b203129e1b6 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:02.741438 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b148ea91-c315-438b-bd6c-9b203129e1b6 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:02.876419 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b148ea91-c315-438b-bd6c-9b203129e1b6 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:02.883835 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b148ea91-c315-438b-bd6c-9b203129e1b6 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6" status: 200 len: 1366 microversion: 2.1 time: 0.157915 Aug 17 08:45:02.884405 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 348/683] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:02 2022] GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:45:03.906249 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5377c9c9-53a0-4504-99a9-ffe3ba875b94 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:03.907654 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5377c9c9-53a0-4504-99a9-ffe3ba875b94 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: db02d6b1-c272-4c1d-8700-3e096703b1d6] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:03.914231 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5377c9c9-53a0-4504-99a9-ffe3ba875b94 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:03.914723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5377c9c9-53a0-4504-99a9-ffe3ba875b94 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:03.915166 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5377c9c9-53a0-4504-99a9-ffe3ba875b94 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:03.915905 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5377c9c9-53a0-4504-99a9-ffe3ba875b94 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:03.916575 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5377c9c9-53a0-4504-99a9-ffe3ba875b94 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:03.917000 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5377c9c9-53a0-4504-99a9-ffe3ba875b94 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:04.213867 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5377c9c9-53a0-4504-99a9-ffe3ba875b94 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:04.223882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5377c9c9-53a0-4504-99a9-ffe3ba875b94 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6" status: 200 len: 1366 microversion: 2.1 time: 0.322661 Aug 17 08:45:04.224415 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 336/684] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:03 2022] GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6 => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:45:05.245306 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-88d0a7f3-1083-4a75-a46a-d300df7dec8d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:05.245994 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-88d0a7f3-1083-4a75-a46a-d300df7dec8d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: db02d6b1-c272-4c1d-8700-3e096703b1d6] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:05.257472 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-88d0a7f3-1083-4a75-a46a-d300df7dec8d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:05.258124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-88d0a7f3-1083-4a75-a46a-d300df7dec8d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:05.258637 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-88d0a7f3-1083-4a75-a46a-d300df7dec8d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:05.259351 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-88d0a7f3-1083-4a75-a46a-d300df7dec8d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:05.261655 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-88d0a7f3-1083-4a75-a46a-d300df7dec8d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:05.262091 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-88d0a7f3-1083-4a75-a46a-d300df7dec8d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:05.428991 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-88d0a7f3-1083-4a75-a46a-d300df7dec8d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:05.441551 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-88d0a7f3-1083-4a75-a46a-d300df7dec8d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6" status: 200 len: 1366 microversion: 2.1 time: 0.199867 Aug 17 08:45:05.442267 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 349/685] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:05 2022] GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:45:06.000078 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-b5f8b7d3-4c05-4c87-8989-7a6599b00337 req-7a54d5f1-4a80-4499-9994-2ba9f7b31611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db02d6b1-c272-4c1d-8700-3e096703b1d6", "name": "network-vif-plugged", "status": "completed", "tag": "a648f16a-8281-46de-a07c-3ad62496891a"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:45:06.009799 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-b5f8b7d3-4c05-4c87-8989-7a6599b00337 req-7a54d5f1-4a80-4499-9994-2ba9f7b31611 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:06.010588 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-b5f8b7d3-4c05-4c87-8989-7a6599b00337 req-7a54d5f1-4a80-4499-9994-2ba9f7b31611 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:06.011198 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-b5f8b7d3-4c05-4c87-8989-7a6599b00337 req-7a54d5f1-4a80-4499-9994-2ba9f7b31611 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:06.023857 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-b5f8b7d3-4c05-4c87-8989-7a6599b00337 req-7a54d5f1-4a80-4499-9994-2ba9f7b31611 service nova] Creating event network-vif-plugged:a648f16a-8281-46de-a07c-3ad62496891a for instance db02d6b1-c272-4c1d-8700-3e096703b1d6 on hv-cinder-85331 Aug 17 08:45:06.029851 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-b5f8b7d3-4c05-4c87-8989-7a6599b00337 req-7a54d5f1-4a80-4499-9994-2ba9f7b31611 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033856 Aug 17 08:45:06.031093 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 337/686] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:45:06.462130 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-26cc5e45-f71c-4b40-b102-32e0b03b3869 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:06.462725 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-26cc5e45-f71c-4b40-b102-32e0b03b3869 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: db02d6b1-c272-4c1d-8700-3e096703b1d6] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:06.471212 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-26cc5e45-f71c-4b40-b102-32e0b03b3869 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:06.471994 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-26cc5e45-f71c-4b40-b102-32e0b03b3869 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:06.472538 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-26cc5e45-f71c-4b40-b102-32e0b03b3869 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:06.473470 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-26cc5e45-f71c-4b40-b102-32e0b03b3869 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:06.474072 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-26cc5e45-f71c-4b40-b102-32e0b03b3869 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:06.474753 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-26cc5e45-f71c-4b40-b102-32e0b03b3869 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:06.495584 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=100 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:06.640936 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-26cc5e45-f71c-4b40-b102-32e0b03b3869 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:06.649735 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-26cc5e45-f71c-4b40-b102-32e0b03b3869 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6" status: 200 len: 1366 microversion: 2.1 time: 0.191371 Aug 17 08:45:06.650889 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 350/687] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:06 2022] GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:45:07.671243 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-34d7860a-4728-4b32-bf06-7613234c25a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:07.671973 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-34d7860a-4728-4b32-bf06-7613234c25a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: db02d6b1-c272-4c1d-8700-3e096703b1d6] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:07.677955 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-34d7860a-4728-4b32-bf06-7613234c25a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:07.678434 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-34d7860a-4728-4b32-bf06-7613234c25a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:07.678856 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-34d7860a-4728-4b32-bf06-7613234c25a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:07.679527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-34d7860a-4728-4b32-bf06-7613234c25a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:07.680046 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-34d7860a-4728-4b32-bf06-7613234c25a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:07.680563 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-34d7860a-4728-4b32-bf06-7613234c25a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:07.791432 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:07.835829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-34d7860a-4728-4b32-bf06-7613234c25a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:07.843499 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-34d7860a-4728-4b32-bf06-7613234c25a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6" status: 200 len: 1556 microversion: 2.1 time: 0.177042 Aug 17 08:45:07.844089 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 338/688] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:07 2022] GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6 => generated 1556 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:45:07.866968 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3bcb9533-dabb-45e1-ab41-2f62f5574e2b tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:07.867487 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3bcb9533-dabb-45e1-ab41-2f62f5574e2b tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: db02d6b1-c272-4c1d-8700-3e096703b1d6] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:07.875631 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3bcb9533-dabb-45e1-ab41-2f62f5574e2b tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:07.876431 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3bcb9533-dabb-45e1-ab41-2f62f5574e2b tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:07.877022 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3bcb9533-dabb-45e1-ab41-2f62f5574e2b tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:07.877965 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3bcb9533-dabb-45e1-ab41-2f62f5574e2b tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:07.878414 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3bcb9533-dabb-45e1-ab41-2f62f5574e2b tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:07.878826 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3bcb9533-dabb-45e1-ab41-2f62f5574e2b tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:07.962678 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3bcb9533-dabb-45e1-ab41-2f62f5574e2b tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100459 Aug 17 08:45:07.963380 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 351/689] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 17 08:45:07 2022] GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:45:08.985824 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-d05c2d9a-2ae7-4cb5-b462-a9845939142a req-328b297d-66d0-4ba3-8965-a44bb44d4355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db02d6b1-c272-4c1d-8700-3e096703b1d6", "tag": "a648f16a-8281-46de-a07c-3ad62496891a"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:45:08.994360 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=10 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:08.997693 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-d05c2d9a-2ae7-4cb5-b462-a9845939142a req-328b297d-66d0-4ba3-8965-a44bb44d4355 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:08.998227 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-d05c2d9a-2ae7-4cb5-b462-a9845939142a req-328b297d-66d0-4ba3-8965-a44bb44d4355 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:08.998855 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-d05c2d9a-2ae7-4cb5-b462-a9845939142a req-328b297d-66d0-4ba3-8965-a44bb44d4355 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:09.013832 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-d05c2d9a-2ae7-4cb5-b462-a9845939142a req-328b297d-66d0-4ba3-8965-a44bb44d4355 service nova] Creating event network-changed:a648f16a-8281-46de-a07c-3ad62496891a for instance db02d6b1-c272-4c1d-8700-3e096703b1d6 on hv-cinder-85331 Aug 17 08:45:09.019903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-d05c2d9a-2ae7-4cb5-b462-a9845939142a req-328b297d-66d0-4ba3-8965-a44bb44d4355 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039176 Aug 17 08:45:09.024630 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 339/690] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:45:12.895678 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:13.092452 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-520da1d3-5eff-49ff-86ef-599a4db549ab tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Action: 'create', calling method: .version_select at 0x7f3f854eab80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-450789034", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6N90jTE47yss1b5pmUapBoBYoceOnRi/JGzxCV01wahNiJUMAPWYzYNKPh98gT3eyiSqDVooo7KMWo2AGD005zOuTosI+ga39VOR9pC2Tnu07D2agFHSz4n1IRm7BMig=="}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:45:13.109555 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-520da1d3-5eff-49ff-86ef-599a4db549ab tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Getting quotas for project e2604417eb5f48f0b026b00a9c164e08. Resources: {'key_pairs'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:45:13.114010 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-520da1d3-5eff-49ff-86ef-599a4db549ab tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Getting quotas for user 73a4f1987dda43068520217d36d99799 and project e2604417eb5f48f0b026b00a9c164e08. Resources: {'key_pairs'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:45:13.143095 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-520da1d3-5eff-49ff-86ef-599a4db549ab tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.248018 Aug 17 08:45:13.144197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 352/691] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 08:45:12 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:45:29.355390 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=4 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:29.356212 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=53 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:29.361180 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-cfe18df2-646e-4c53-b225-1bcd549e6fad tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-985475931", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-450789034", "security_groups": [{"name": "tempest-secgroup-smoke-604269867"}], "block_device_mapping_v2": [{"uuid": "1342018d-bc3f-4eb8-aefd-39f17a969404", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2cc8fb46-3628-4864-93c3-c9178d343e2b"}]}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:45:29.474907 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.network.neutron [None req-cfe18df2-646e-4c53-b225-1bcd549e6fad tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] validate_networks() for [('2cc8fb46-3628-4864-93c3-c9178d343e2b', None, None, None, None, None)] {{(pid=127298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 08:45:29.835836 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-cfe18df2-646e-4c53-b225-1bcd549e6fad tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Flavor limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 08:45:29.836252 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-cfe18df2-646e-4c53-b225-1bcd549e6fad tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Image limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 08:45:29.836712 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-cfe18df2-646e-4c53-b225-1bcd549e6fad tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Flavor pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 08:45:29.837113 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-cfe18df2-646e-4c53-b225-1bcd549e6fad tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Image pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 08:45:29.837511 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-cfe18df2-646e-4c53-b225-1bcd549e6fad tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 08:45:29.846598 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cfe18df2-646e-4c53-b225-1bcd549e6fad tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:29.847058 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cfe18df2-646e-4c53-b225-1bcd549e6fad tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:29.847480 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cfe18df2-646e-4c53-b225-1bcd549e6fad tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:29.848205 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cfe18df2-646e-4c53-b225-1bcd549e6fad tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:29.848646 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cfe18df2-646e-4c53-b225-1bcd549e6fad tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:29.849056 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cfe18df2-646e-4c53-b225-1bcd549e6fad tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:29.865587 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-cfe18df2-646e-4c53-b225-1bcd549e6fad tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Getting quotas for project e2604417eb5f48f0b026b00a9c164e08. Resources: {'cores', 'instances', 'ram'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:45:29.869826 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-cfe18df2-646e-4c53-b225-1bcd549e6fad tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Getting quotas for user 73a4f1987dda43068520217d36d99799 and project e2604417eb5f48f0b026b00a9c164e08. Resources: {'cores', 'instances', 'ram'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:45:29.925732 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-cfe18df2-646e-4c53-b225-1bcd549e6fad tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Going to run 1 instances... {{(pid=127298) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 08:45:29.928016 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-cfe18df2-646e-4c53-b225-1bcd549e6fad tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1342018d-bc3f-4eb8-aefd-39f17a969404',volume_size=None,volume_type=None)] {{(pid=127298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 08:45:30.051205 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-cfe18df2-646e-4c53-b225-1bcd549e6fad tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.697190 Aug 17 08:45:30.051860 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 340/692] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 08:45:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 08:45:30.063694 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6830699e-83ab-436c-a816-94b0152c61d2 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:30.064299 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6830699e-83ab-436c-a816-94b0152c61d2 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:30.067708 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=7 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:30.068763 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=4 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:30.069567 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:30.135448 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6830699e-83ab-436c-a816-94b0152c61d2 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:30.142163 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6830699e-83ab-436c-a816-94b0152c61d2 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa" status: 200 len: 1093 microversion: 2.1 time: 0.083316 Aug 17 08:45:30.142721 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 353/693] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:30 2022] GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa => generated 1093 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:45:31.162669 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ff7dcdff-74c5-4a11-a7ec-47974043d11a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:31.163418 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ff7dcdff-74c5-4a11-a7ec-47974043d11a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:31.170167 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ff7dcdff-74c5-4a11-a7ec-47974043d11a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:31.170654 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ff7dcdff-74c5-4a11-a7ec-47974043d11a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:31.171202 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ff7dcdff-74c5-4a11-a7ec-47974043d11a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:31.171831 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ff7dcdff-74c5-4a11-a7ec-47974043d11a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:31.172283 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ff7dcdff-74c5-4a11-a7ec-47974043d11a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:31.172705 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ff7dcdff-74c5-4a11-a7ec-47974043d11a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:31.239990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ff7dcdff-74c5-4a11-a7ec-47974043d11a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:31.247453 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ff7dcdff-74c5-4a11-a7ec-47974043d11a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa" status: 200 len: 1209 microversion: 2.1 time: 0.089072 Aug 17 08:45:31.248048 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 341/694] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:31 2022] GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa => generated 1209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:45:32.268517 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1793e235-afb4-430c-9471-95e3e053b00e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:32.269263 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1793e235-afb4-430c-9471-95e3e053b00e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:32.275584 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1793e235-afb4-430c-9471-95e3e053b00e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:32.276077 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1793e235-afb4-430c-9471-95e3e053b00e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:32.276508 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1793e235-afb4-430c-9471-95e3e053b00e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:32.277197 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1793e235-afb4-430c-9471-95e3e053b00e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:32.277650 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1793e235-afb4-430c-9471-95e3e053b00e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:32.278070 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1793e235-afb4-430c-9471-95e3e053b00e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:32.411226 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-1793e235-afb4-430c-9471-95e3e053b00e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:32.419938 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1793e235-afb4-430c-9471-95e3e053b00e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa" status: 200 len: 1264 microversion: 2.1 time: 0.154822 Aug 17 08:45:32.420650 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 354/695] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:32 2022] GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:45:32.446984 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-85d0d014-6410-4645-ab03-26cd6e5ba9ce req-c63179a4-0688-4fc1-acda-c1863239213e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7121f229-54ff-4621-a114-ae43449afcaa", "tag": "68dd16d1-6450-4d16-9965-73c35488b738"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:45:32.458389 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-85d0d014-6410-4645-ab03-26cd6e5ba9ce req-c63179a4-0688-4fc1-acda-c1863239213e service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:32.458944 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-85d0d014-6410-4645-ab03-26cd6e5ba9ce req-c63179a4-0688-4fc1-acda-c1863239213e service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:32.459435 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-85d0d014-6410-4645-ab03-26cd6e5ba9ce req-c63179a4-0688-4fc1-acda-c1863239213e service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:32.471125 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-85d0d014-6410-4645-ab03-26cd6e5ba9ce req-c63179a4-0688-4fc1-acda-c1863239213e service nova] Creating event network-changed:68dd16d1-6450-4d16-9965-73c35488b738 for instance 7121f229-54ff-4621-a114-ae43449afcaa on hv-cinder-85331 Aug 17 08:45:32.476234 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-85d0d014-6410-4645-ab03-26cd6e5ba9ce req-c63179a4-0688-4fc1-acda-c1863239213e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033328 Aug 17 08:45:32.476934 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 342/696] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:45:33.440247 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2cf7f3b3-6b82-4049-9931-29eddbec411a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:33.440846 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-2cf7f3b3-6b82-4049-9931-29eddbec411a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:33.446820 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2cf7f3b3-6b82-4049-9931-29eddbec411a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:33.447303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2cf7f3b3-6b82-4049-9931-29eddbec411a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:33.447775 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2cf7f3b3-6b82-4049-9931-29eddbec411a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:33.448459 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2cf7f3b3-6b82-4049-9931-29eddbec411a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:33.448910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2cf7f3b3-6b82-4049-9931-29eddbec411a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:33.449327 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2cf7f3b3-6b82-4049-9931-29eddbec411a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:33.580205 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-2cf7f3b3-6b82-4049-9931-29eddbec411a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:33.587684 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2cf7f3b3-6b82-4049-9931-29eddbec411a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa" status: 200 len: 1264 microversion: 2.1 time: 0.151203 Aug 17 08:45:33.588256 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 355/697] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:33 2022] GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:45:34.608553 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3ec85cff-d075-4874-925f-289c60b736cc tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:34.609274 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3ec85cff-d075-4874-925f-289c60b736cc tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:34.615402 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3ec85cff-d075-4874-925f-289c60b736cc tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:34.615911 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3ec85cff-d075-4874-925f-289c60b736cc tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:34.616342 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3ec85cff-d075-4874-925f-289c60b736cc tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:34.617023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3ec85cff-d075-4874-925f-289c60b736cc tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:34.617470 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3ec85cff-d075-4874-925f-289c60b736cc tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:34.617889 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3ec85cff-d075-4874-925f-289c60b736cc tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:34.744491 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-3ec85cff-d075-4874-925f-289c60b736cc tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:34.752383 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3ec85cff-d075-4874-925f-289c60b736cc tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa" status: 200 len: 1264 microversion: 2.1 time: 0.148607 Aug 17 08:45:34.752950 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 343/698] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:34 2022] GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:45:35.772145 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b1f493d5-2680-4d84-bc0a-b7c3b097827b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:35.772683 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b1f493d5-2680-4d84-bc0a-b7c3b097827b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:35.779697 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b1f493d5-2680-4d84-bc0a-b7c3b097827b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:35.780174 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b1f493d5-2680-4d84-bc0a-b7c3b097827b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:35.780603 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b1f493d5-2680-4d84-bc0a-b7c3b097827b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:35.781281 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b1f493d5-2680-4d84-bc0a-b7c3b097827b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:35.781729 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b1f493d5-2680-4d84-bc0a-b7c3b097827b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:35.782147 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b1f493d5-2680-4d84-bc0a-b7c3b097827b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:35.911822 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b1f493d5-2680-4d84-bc0a-b7c3b097827b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:35.919222 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b1f493d5-2680-4d84-bc0a-b7c3b097827b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa" status: 200 len: 1264 microversion: 2.1 time: 0.150909 Aug 17 08:45:35.919824 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 356/699] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:35 2022] GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:45:36.940098 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-598bd5c2-fa86-43e4-b16a-ca57a4e52ef3 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:36.940695 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-598bd5c2-fa86-43e4-b16a-ca57a4e52ef3 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:36.946891 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-598bd5c2-fa86-43e4-b16a-ca57a4e52ef3 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:36.947361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-598bd5c2-fa86-43e4-b16a-ca57a4e52ef3 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:36.947813 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-598bd5c2-fa86-43e4-b16a-ca57a4e52ef3 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:36.948486 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-598bd5c2-fa86-43e4-b16a-ca57a4e52ef3 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:36.948924 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-598bd5c2-fa86-43e4-b16a-ca57a4e52ef3 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:36.949335 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-598bd5c2-fa86-43e4-b16a-ca57a4e52ef3 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:37.080432 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-598bd5c2-fa86-43e4-b16a-ca57a4e52ef3 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:37.087714 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-598bd5c2-fa86-43e4-b16a-ca57a4e52ef3 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa" status: 200 len: 1264 microversion: 2.1 time: 0.151529 Aug 17 08:45:37.088268 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 344/700] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:36 2022] GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:45:38.107885 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-240e4f24-1f26-45e2-bf6b-4a78cbf7316f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:38.108512 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-240e4f24-1f26-45e2-bf6b-4a78cbf7316f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:38.114988 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-240e4f24-1f26-45e2-bf6b-4a78cbf7316f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:38.115461 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-240e4f24-1f26-45e2-bf6b-4a78cbf7316f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:38.115919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-240e4f24-1f26-45e2-bf6b-4a78cbf7316f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:38.116588 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-240e4f24-1f26-45e2-bf6b-4a78cbf7316f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:38.117033 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-240e4f24-1f26-45e2-bf6b-4a78cbf7316f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:38.117448 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-240e4f24-1f26-45e2-bf6b-4a78cbf7316f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:38.244628 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-240e4f24-1f26-45e2-bf6b-4a78cbf7316f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:38.252530 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-240e4f24-1f26-45e2-bf6b-4a78cbf7316f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa" status: 200 len: 1264 microversion: 2.1 time: 0.148599 Aug 17 08:45:38.253096 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 357/701] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:38 2022] GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:45:39.273294 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-9cc2cdf0-169a-4ba3-b410-531188db40fb tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:39.273890 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-9cc2cdf0-169a-4ba3-b410-531188db40fb tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:39.280402 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9cc2cdf0-169a-4ba3-b410-531188db40fb tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:39.280880 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9cc2cdf0-169a-4ba3-b410-531188db40fb tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:39.281306 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9cc2cdf0-169a-4ba3-b410-531188db40fb tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:39.281970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9cc2cdf0-169a-4ba3-b410-531188db40fb tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:39.282409 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9cc2cdf0-169a-4ba3-b410-531188db40fb tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:39.282820 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-9cc2cdf0-169a-4ba3-b410-531188db40fb tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:39.410252 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-9cc2cdf0-169a-4ba3-b410-531188db40fb tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:39.417546 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-9cc2cdf0-169a-4ba3-b410-531188db40fb tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa" status: 200 len: 1264 microversion: 2.1 time: 0.148108 Aug 17 08:45:39.418130 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 345/702] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:39 2022] GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:45:40.160757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-2ef4a209-7926-4f94-adea-192b397c0002 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:40.161373 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-2ef4a209-7926-4f94-adea-192b397c0002 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:40.165326 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:40.170818 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2ef4a209-7926-4f94-adea-192b397c0002 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:40.171291 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2ef4a209-7926-4f94-adea-192b397c0002 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:40.171753 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2ef4a209-7926-4f94-adea-192b397c0002 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:40.172432 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2ef4a209-7926-4f94-adea-192b397c0002 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:40.172874 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2ef4a209-7926-4f94-adea-192b397c0002 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:40.173286 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-2ef4a209-7926-4f94-adea-192b397c0002 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:40.202307 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-2ef4a209-7926-4f94-adea-192b397c0002 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032/os-volume_attachments/85510322-b09b-41cd-a6d5-8fcf0b07f194" status: 200 len: 194 microversion: 2.20 time: 0.045584 Aug 17 08:45:40.202874 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 358/703] 10.222.0.15 () {60 vars in 1454 bytes} [Wed Aug 17 08:45:40 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032/os-volume_attachments/85510322-b09b-41cd-a6d5-8fcf0b07f194 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 08:45:40.270839 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3c00a053-9af6-4aaf-96a1-1ffcd2437375 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:40.270965 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3c00a053-9af6-4aaf-96a1-1ffcd2437375 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:40.272925 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:40.273636 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=6 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:40.280289 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3c00a053-9af6-4aaf-96a1-1ffcd2437375 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:40.280685 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3c00a053-9af6-4aaf-96a1-1ffcd2437375 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:40.281121 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3c00a053-9af6-4aaf-96a1-1ffcd2437375 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:40.281818 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3c00a053-9af6-4aaf-96a1-1ffcd2437375 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:40.282262 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3c00a053-9af6-4aaf-96a1-1ffcd2437375 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:40.282681 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3c00a053-9af6-4aaf-96a1-1ffcd2437375 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:40.363397 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-3c00a053-9af6-4aaf-96a1-1ffcd2437375 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lazy-loading 'services' on Instance uuid 42e06cf4-bb49-4d51-93c1-3147069bd032 {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:45:40.438340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3c00a053-9af6-4aaf-96a1-1ffcd2437375 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "DELETE /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032/os-volume_attachments/85510322-b09b-41cd-a6d5-8fcf0b07f194" status: 202 len: 0 microversion: 2.20 time: 0.171717 Aug 17 08:45:40.438987 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 346/704] 10.222.0.15 () {60 vars in 1457 bytes} [Wed Aug 17 08:45:40 2022] DELETE /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032/os-volume_attachments/85510322-b09b-41cd-a6d5-8fcf0b07f194 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 08:45:40.441948 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1b506eb2-248d-4463-b343-2fc692e8e1e8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:40.442749 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1b506eb2-248d-4463-b343-2fc692e8e1e8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:40.447453 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d2fcc927-eceb-4ea4-b64c-07ffe1d94612 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:40.449683 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d2fcc927-eceb-4ea4-b64c-07ffe1d94612 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:40.450693 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1b506eb2-248d-4463-b343-2fc692e8e1e8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:40.451612 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1b506eb2-248d-4463-b343-2fc692e8e1e8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:40.452509 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1b506eb2-248d-4463-b343-2fc692e8e1e8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:40.452721 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1b506eb2-248d-4463-b343-2fc692e8e1e8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:40.453172 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1b506eb2-248d-4463-b343-2fc692e8e1e8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:40.453586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1b506eb2-248d-4463-b343-2fc692e8e1e8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:40.456142 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d2fcc927-eceb-4ea4-b64c-07ffe1d94612 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:40.456630 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d2fcc927-eceb-4ea4-b64c-07ffe1d94612 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:40.457057 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d2fcc927-eceb-4ea4-b64c-07ffe1d94612 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:40.457741 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d2fcc927-eceb-4ea4-b64c-07ffe1d94612 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:40.458188 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d2fcc927-eceb-4ea4-b64c-07ffe1d94612 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:40.458720 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d2fcc927-eceb-4ea4-b64c-07ffe1d94612 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:40.492166 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d2fcc927-eceb-4ea4-b64c-07ffe1d94612 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048755 Aug 17 08:45:40.493541 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 347/705] 10.222.0.15 () {60 vars in 1343 bytes} [Wed Aug 17 08:45:40 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 08:45:40.602671 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-1b506eb2-248d-4463-b343-2fc692e8e1e8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:40.610873 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1b506eb2-248d-4463-b343-2fc692e8e1e8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa" status: 200 len: 1264 microversion: 2.1 time: 0.176246 Aug 17 08:45:40.611451 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 359/706] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:40 2022] GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:45:41.504811 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1481f5c2-e964-42d3-bfbe-3ed4a5698c2b tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:41.506940 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1481f5c2-e964-42d3-bfbe-3ed4a5698c2b tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:41.514142 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1481f5c2-e964-42d3-bfbe-3ed4a5698c2b tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:41.514612 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1481f5c2-e964-42d3-bfbe-3ed4a5698c2b tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:41.515035 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1481f5c2-e964-42d3-bfbe-3ed4a5698c2b tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:41.515740 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1481f5c2-e964-42d3-bfbe-3ed4a5698c2b tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:41.516179 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1481f5c2-e964-42d3-bfbe-3ed4a5698c2b tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:41.516587 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1481f5c2-e964-42d3-bfbe-3ed4a5698c2b tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:41.544281 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1481f5c2-e964-42d3-bfbe-3ed4a5698c2b tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043447 Aug 17 08:45:41.544825 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 348/707] 10.222.0.15 () {60 vars in 1343 bytes} [Wed Aug 17 08:45:41 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:45:41.605681 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d6a929ef-468f-4930-a964-78d199eab09d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:41.606810 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d6a929ef-468f-4930-a964-78d199eab09d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:41.613201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d6a929ef-468f-4930-a964-78d199eab09d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:41.613688 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d6a929ef-468f-4930-a964-78d199eab09d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:41.614112 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d6a929ef-468f-4930-a964-78d199eab09d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:41.614797 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d6a929ef-468f-4930-a964-78d199eab09d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:41.615246 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d6a929ef-468f-4930-a964-78d199eab09d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:41.615701 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d6a929ef-468f-4930-a964-78d199eab09d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:41.630036 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-631d6816-522d-4673-813e-7e6930822366 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:41.630624 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-631d6816-522d-4673-813e-7e6930822366 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:41.636428 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-631d6816-522d-4673-813e-7e6930822366 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:41.636895 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-631d6816-522d-4673-813e-7e6930822366 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:41.637315 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-631d6816-522d-4673-813e-7e6930822366 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:41.638017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-631d6816-522d-4673-813e-7e6930822366 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:41.638452 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-631d6816-522d-4673-813e-7e6930822366 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:41.638857 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-631d6816-522d-4673-813e-7e6930822366 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:41.641384 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d6a929ef-468f-4930-a964-78d199eab09d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Going to try to terminate instance {{(pid=127297) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 08:45:41.721426 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d6a929ef-468f-4930-a964-78d199eab09d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "DELETE /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 204 len: 0 microversion: 2.20 time: 0.119257 Aug 17 08:45:41.722239 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 360/708] 10.222.0.15 () {60 vars in 1280 bytes} [Wed Aug 17 08:45:41 2022] DELETE /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 08:45:41.731923 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-996bfcd9-3c9d-4ea4-9aab-db39b9f5ae94 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:41.732604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-996bfcd9-3c9d-4ea4-9aab-db39b9f5ae94 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:41.738406 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-996bfcd9-3c9d-4ea4-9aab-db39b9f5ae94 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:41.738880 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-996bfcd9-3c9d-4ea4-9aab-db39b9f5ae94 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:41.739307 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-996bfcd9-3c9d-4ea4-9aab-db39b9f5ae94 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:41.740008 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-996bfcd9-3c9d-4ea4-9aab-db39b9f5ae94 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:41.740450 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-996bfcd9-3c9d-4ea4-9aab-db39b9f5ae94 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:41.740862 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-996bfcd9-3c9d-4ea4-9aab-db39b9f5ae94 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:41.781963 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-631d6816-522d-4673-813e-7e6930822366 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:41.789623 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-631d6816-522d-4673-813e-7e6930822366 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa" status: 200 len: 1264 microversion: 2.1 time: 0.163312 Aug 17 08:45:41.790195 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 349/709] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:41 2022] GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:45:41.873914 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-996bfcd9-3c9d-4ea4-9aab-db39b9f5ae94 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:41.882401 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-996bfcd9-3c9d-4ea4-9aab-db39b9f5ae94 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:41.884046 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-996bfcd9-3c9d-4ea4-9aab-db39b9f5ae94 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:41.885278 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-996bfcd9-3c9d-4ea4-9aab-db39b9f5ae94 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1722 microversion: 2.20 time: 0.157895 Aug 17 08:45:41.886089 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 361/710] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:45:41 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:45:41.966503 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-03a13a78-4cd2-4aa0-8934-69959e5aa6a0 req-311d246b-521d-45cc-ab99-0e64503416b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7121f229-54ff-4621-a114-ae43449afcaa", "name": "network-vif-plugged", "status": "completed", "tag": "68dd16d1-6450-4d16-9965-73c35488b738"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:45:41.977265 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-03a13a78-4cd2-4aa0-8934-69959e5aa6a0 req-311d246b-521d-45cc-ab99-0e64503416b6 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:41.977803 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-03a13a78-4cd2-4aa0-8934-69959e5aa6a0 req-311d246b-521d-45cc-ab99-0e64503416b6 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:41.978254 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-03a13a78-4cd2-4aa0-8934-69959e5aa6a0 req-311d246b-521d-45cc-ab99-0e64503416b6 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:41.990978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-03a13a78-4cd2-4aa0-8934-69959e5aa6a0 req-311d246b-521d-45cc-ab99-0e64503416b6 service nova] Creating event network-vif-plugged:68dd16d1-6450-4d16-9965-73c35488b738 for instance 7121f229-54ff-4621-a114-ae43449afcaa on hv-cinder-85331 Aug 17 08:45:41.995904 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-03a13a78-4cd2-4aa0-8934-69959e5aa6a0 req-311d246b-521d-45cc-ab99-0e64503416b6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033627 Aug 17 08:45:41.996533 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 350/711] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:45:42.811150 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e745a37d-aa1f-496f-98b1-ed455418cbc8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:42.811762 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e745a37d-aa1f-496f-98b1-ed455418cbc8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:42.818151 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e745a37d-aa1f-496f-98b1-ed455418cbc8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:42.818623 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e745a37d-aa1f-496f-98b1-ed455418cbc8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:42.819051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e745a37d-aa1f-496f-98b1-ed455418cbc8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:42.819759 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e745a37d-aa1f-496f-98b1-ed455418cbc8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:42.820207 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e745a37d-aa1f-496f-98b1-ed455418cbc8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:42.820624 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e745a37d-aa1f-496f-98b1-ed455418cbc8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:42.909616 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-959f271b-1c8f-41f8-af29-b748b7051da7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:42.910308 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-959f271b-1c8f-41f8-af29-b748b7051da7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:42.916705 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-959f271b-1c8f-41f8-af29-b748b7051da7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:42.917191 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-959f271b-1c8f-41f8-af29-b748b7051da7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:42.917622 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-959f271b-1c8f-41f8-af29-b748b7051da7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:42.918311 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-959f271b-1c8f-41f8-af29-b748b7051da7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:42.918758 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-959f271b-1c8f-41f8-af29-b748b7051da7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:42.919176 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-959f271b-1c8f-41f8-af29-b748b7051da7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:42.949463 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e745a37d-aa1f-496f-98b1-ed455418cbc8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:42.957889 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e745a37d-aa1f-496f-98b1-ed455418cbc8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa" status: 200 len: 1264 microversion: 2.1 time: 0.151125 Aug 17 08:45:42.958467 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 362/712] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:42 2022] GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:45:43.044980 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-959f271b-1c8f-41f8-af29-b748b7051da7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:43.052803 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-959f271b-1c8f-41f8-af29-b748b7051da7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:43.054299 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-959f271b-1c8f-41f8-af29-b748b7051da7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:43.055437 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-959f271b-1c8f-41f8-af29-b748b7051da7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1722 microversion: 2.20 time: 0.150542 Aug 17 08:45:43.056026 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 351/713] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:45:42 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 08:45:43.979125 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-21fc5a02-cb01-4c99-89ff-7a2620a33f40 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:43.979740 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-21fc5a02-cb01-4c99-89ff-7a2620a33f40 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:43.986515 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-21fc5a02-cb01-4c99-89ff-7a2620a33f40 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:43.987149 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-21fc5a02-cb01-4c99-89ff-7a2620a33f40 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:43.987599 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-21fc5a02-cb01-4c99-89ff-7a2620a33f40 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:43.988288 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-21fc5a02-cb01-4c99-89ff-7a2620a33f40 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:43.988738 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-21fc5a02-cb01-4c99-89ff-7a2620a33f40 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:43.989156 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-21fc5a02-cb01-4c99-89ff-7a2620a33f40 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:44.079095 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-63f489ed-ed58-4beb-8111-065f8be62239 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:44.079811 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-63f489ed-ed58-4beb-8111-065f8be62239 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:44.086354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-63f489ed-ed58-4beb-8111-065f8be62239 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:44.086917 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-63f489ed-ed58-4beb-8111-065f8be62239 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:44.087420 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-63f489ed-ed58-4beb-8111-065f8be62239 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:44.088268 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-63f489ed-ed58-4beb-8111-065f8be62239 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:44.088711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-63f489ed-ed58-4beb-8111-065f8be62239 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:44.089200 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-63f489ed-ed58-4beb-8111-065f8be62239 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:44.121868 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-21fc5a02-cb01-4c99-89ff-7a2620a33f40 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:44.129422 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-21fc5a02-cb01-4c99-89ff-7a2620a33f40 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa" status: 200 len: 1264 microversion: 2.1 time: 0.154466 Aug 17 08:45:44.130000 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 363/714] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:43 2022] GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:45:44.214869 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-63f489ed-ed58-4beb-8111-065f8be62239 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:44.224221 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-63f489ed-ed58-4beb-8111-065f8be62239 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:44.225861 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-63f489ed-ed58-4beb-8111-065f8be62239 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:44.227005 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-63f489ed-ed58-4beb-8111-065f8be62239 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1722 microversion: 2.20 time: 0.152529 Aug 17 08:45:44.227578 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 352/715] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:45:44 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 08:45:45.146686 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-a956c0d7-4854-4754-a195-c2825eea3b57 req-26e34f35-79ba-4523-9b64-cfb20f52d686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e06cf4-bb49-4d51-93c1-3147069bd032", "name": "network-vif-deleted", "tag": "bc2b2be5-4c28-489f-8bda-05bbb62b4e19"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:45:45.149877 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3f23dec7-ae4c-4e83-b494-3fd1effa8b65 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:45.150478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3f23dec7-ae4c-4e83-b494-3fd1effa8b65 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:45.159158 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-a956c0d7-4854-4754-a195-c2825eea3b57 req-26e34f35-79ba-4523-9b64-cfb20f52d686 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:45.159420 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3f23dec7-ae4c-4e83-b494-3fd1effa8b65 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:45.159761 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-a956c0d7-4854-4754-a195-c2825eea3b57 req-26e34f35-79ba-4523-9b64-cfb20f52d686 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:45.159868 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3f23dec7-ae4c-4e83-b494-3fd1effa8b65 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:45.160260 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3f23dec7-ae4c-4e83-b494-3fd1effa8b65 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:45.160378 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-a956c0d7-4854-4754-a195-c2825eea3b57 req-26e34f35-79ba-4523-9b64-cfb20f52d686 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:45.160955 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3f23dec7-ae4c-4e83-b494-3fd1effa8b65 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:45.161626 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3f23dec7-ae4c-4e83-b494-3fd1effa8b65 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:45.162196 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3f23dec7-ae4c-4e83-b494-3fd1effa8b65 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:45.173046 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-a956c0d7-4854-4754-a195-c2825eea3b57 req-26e34f35-79ba-4523-9b64-cfb20f52d686 service nova] Creating event network-vif-deleted:bc2b2be5-4c28-489f-8bda-05bbb62b4e19 for instance 42e06cf4-bb49-4d51-93c1-3147069bd032 on hv-cinder-85331 Aug 17 08:45:45.178547 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-a956c0d7-4854-4754-a195-c2825eea3b57 req-26e34f35-79ba-4523-9b64-cfb20f52d686 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035847 Aug 17 08:45:45.179833 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 364/716] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:45:45.251949 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-28300853-2a38-4a2d-aeff-cf411bdf2fc9 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:45.253344 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-28300853-2a38-4a2d-aeff-cf411bdf2fc9 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:45.262960 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-28300853-2a38-4a2d-aeff-cf411bdf2fc9 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:45.263854 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-28300853-2a38-4a2d-aeff-cf411bdf2fc9 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:45.264494 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-28300853-2a38-4a2d-aeff-cf411bdf2fc9 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:45.265510 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-28300853-2a38-4a2d-aeff-cf411bdf2fc9 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:45.266231 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-28300853-2a38-4a2d-aeff-cf411bdf2fc9 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:45.266870 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-28300853-2a38-4a2d-aeff-cf411bdf2fc9 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:45.353832 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-28300853-2a38-4a2d-aeff-cf411bdf2fc9 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:45.363216 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-28300853-2a38-4a2d-aeff-cf411bdf2fc9 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:45.364739 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-28300853-2a38-4a2d-aeff-cf411bdf2fc9 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:45.365953 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-28300853-2a38-4a2d-aeff-cf411bdf2fc9 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 200 len: 1655 microversion: 2.20 time: 0.119626 Aug 17 08:45:45.379659 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 365/717] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:45:45 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 1655 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 08:45:45.389035 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-3f23dec7-ae4c-4e83-b494-3fd1effa8b65 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:45.399127 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3f23dec7-ae4c-4e83-b494-3fd1effa8b65 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa" status: 200 len: 1264 microversion: 2.1 time: 0.252617 Aug 17 08:45:45.411578 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 353/718] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:45 2022] GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa => generated 1264 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:45:46.390248 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1df4f76e-f01b-45c2-9aba-d7383b691680 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:46.390846 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1df4f76e-f01b-45c2-9aba-d7383b691680 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:46.397400 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1df4f76e-f01b-45c2-9aba-d7383b691680 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:46.397884 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1df4f76e-f01b-45c2-9aba-d7383b691680 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:46.398318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1df4f76e-f01b-45c2-9aba-d7383b691680 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:46.399036 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1df4f76e-f01b-45c2-9aba-d7383b691680 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:46.399486 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1df4f76e-f01b-45c2-9aba-d7383b691680 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:46.399936 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1df4f76e-f01b-45c2-9aba-d7383b691680 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:46.413194 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-1df4f76e-f01b-45c2-9aba-d7383b691680 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] HTTP exception thrown: Instance 42e06cf4-bb49-4d51-93c1-3147069bd032 could not be found. Aug 17 08:45:46.414867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1df4f76e-f01b-45c2-9aba-d7383b691680 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Request method failure captured: Aug 17 08:45:46.414867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 HTTP/1.1 Aug 17 08:45:46.414867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:45:46.414867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:45:46.414867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:45:46.414867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:45:46.414867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:45:46.414867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:45:46.414867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:45:46.414867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:45:46.414867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_KohAvYrj5W_Z2jwMlBluU7GmlTT6O13XSVTTrpCjQZCZ4ES-7SLbpYEtZZzleqAbqMnkPUGFxsUNXl7LcEs8lxDpkhyA4NBFQuijl1q1Ogx24ms9LWq0vojzRLUXurTqBPcgv66wuXR4dQy0vXjpDAnNUyS0L35h6loPA8VXRTK6PE Aug 17 08:45:46.414867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:45:46.414867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:45:46.414867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:45:46.414867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:45:46.414867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 08:45:46.414867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:45:46.414867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:45:46.414867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: eb857c94e3f6405baad84dfc45445b0d Aug 17 08:45:46.414867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-296675391 Aug 17 08:45:46.414867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:45:46.414867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:45:46.416546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb857c94e3f6405baad84dfc45445b0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/eb857c94e3f6405baad84dfc45445b0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb857c94e3f6405baad84dfc45445b0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_eb857c94e3f6405baad84dfc45445b0d", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:45:46.416546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-AttachVolumeShelveTestJSON-296675391 Aug 17 08:45:46.416546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: eb857c94e3f6405baad84dfc45445b0d Aug 17 08:45:46.416546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-296675391 Aug 17 08:45:46.416546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-AttachVolumeShelveTestJSON-296675391-project Aug 17 08:45:46.416546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:45:46.416546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:45:46.416546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: d586af36267c475ab5af42a23ce3f1b1 Aug 17 08:45:46.416546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-AttachVolumeShelveTestJSON-296675391-project Aug 17 08:45:46.416546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: > Aug 17 08:45:46.416546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Instance 42e06cf4-bb49-4d51-93c1-3147069bd032 could not be found. Aug 17 08:45:46.416546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': '42e06cf4-bb49-4d51-93c1-3147069bd032'} Aug 17 08:45:46.417455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:45:46.417455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:45:46.417455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:45:46.417455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:45:46.417455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:45:46.417455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:45:46.417455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:45:46.417455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:45:46.417455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:45:46.417455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:45:46.417455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42e06cf4-bb49-4d51-93c1-3147069bd032 could not be found. Aug 17 08:45:46.417455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:45:46.417455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:45:46.417455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:45:46.417455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:45:46.417455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:45:46.417455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:45:46.417455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:45:46.417455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:45:46.417455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:45:46.420027 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:45:46.420027 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:45:46.420027 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:45:46.420027 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:45:46.420027 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:45:46.420027 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:45:46.420027 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:45:46.420027 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42e06cf4-bb49-4d51-93c1-3147069bd032 could not be found. Aug 17 08:45:46.420027 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:45:46.420027 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:45:46.420027 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:45:46.420027 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:45:46.420027 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:45:46.420027 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:45:46.420027 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:45:46.420027 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:45:46.420027 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42e06cf4-bb49-4d51-93c1-3147069bd032 could not be found. Aug 17 08:45:46.420027 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:45:46.421703 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1df4f76e-f01b-45c2-9aba-d7383b691680 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Returning 404 to user: Instance 42e06cf4-bb49-4d51-93c1-3147069bd032 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:45:46.421703 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1df4f76e-f01b-45c2-9aba-d7383b691680 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 404 len: 111 microversion: 2.20 time: 0.029941 Aug 17 08:45:46.421703 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 366/719] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:45:46 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 08:45:46.421954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-7e3e1e83-3e54-41fe-9db5-fbaba8e540c9 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:46.421954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7e3e1e83-3e54-41fe-9db5-fbaba8e540c9 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:46.425165 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f9498911-c7d0-4657-ba38-893b700385fb tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '.version_select at 0x7f3f85318a60>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:46.428008 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7e3e1e83-3e54-41fe-9db5-fbaba8e540c9 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:46.428482 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7e3e1e83-3e54-41fe-9db5-fbaba8e540c9 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:46.428901 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7e3e1e83-3e54-41fe-9db5-fbaba8e540c9 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:46.429587 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7e3e1e83-3e54-41fe-9db5-fbaba8e540c9 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:46.430033 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7e3e1e83-3e54-41fe-9db5-fbaba8e540c9 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:46.430475 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7e3e1e83-3e54-41fe-9db5-fbaba8e540c9 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:46.443853 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f9498911-c7d0-4657-ba38-893b700385fb tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-489707631" status: 204 len: 0 microversion: 2.20 time: 0.022018 Aug 17 08:45:46.444617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 367/720] 10.222.0.15 () {60 vars in 1259 bytes} [Wed Aug 17 08:45:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-489707631 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 17 08:45:46.563146 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-7e3e1e83-3e54-41fe-9db5-fbaba8e540c9 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:46.570986 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-7e3e1e83-3e54-41fe-9db5-fbaba8e540c9 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa" status: 200 len: 1451 microversion: 2.1 time: 0.154141 Aug 17 08:45:46.571948 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 354/721] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:46 2022] GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:45:46.599467 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d7f91eeb-4b16-49c6-84ae-7b4cef2adb3e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:46.600343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d7f91eeb-4b16-49c6-84ae-7b4cef2adb3e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:46.621076 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d7f91eeb-4b16-49c6-84ae-7b4cef2adb3e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:46.621636 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d7f91eeb-4b16-49c6-84ae-7b4cef2adb3e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:46.622014 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d7f91eeb-4b16-49c6-84ae-7b4cef2adb3e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:46.622713 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d7f91eeb-4b16-49c6-84ae-7b4cef2adb3e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:46.623238 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d7f91eeb-4b16-49c6-84ae-7b4cef2adb3e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:46.623637 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d7f91eeb-4b16-49c6-84ae-7b4cef2adb3e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:46.757035 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d7f91eeb-4b16-49c6-84ae-7b4cef2adb3e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:46.764760 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d7f91eeb-4b16-49c6-84ae-7b4cef2adb3e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa" status: 200 len: 1451 microversion: 2.1 time: 0.174474 Aug 17 08:45:46.765334 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 368/722] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:46 2022] GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa => generated 1451 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:45:47.073820 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3ecab544-65c9-4a11-a4cc-6c8bbe994568 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Action: 'create', calling method: .version_select at 0x7f3f85240550>, body: {"keypair": {"name": "tempest-keypair-504629478", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIImIg/qg+SjXajiQq8KE32BnTX5Y5g0eYqQGw3xNaRtm7k9AJOYE7zJNYdC+eOtUoMfSpycAZYVtOAb828I0fpgt/rqsXm53C0Xyrez8rFj4rtlaSUUDcB4EHDr8yxFhw=="}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:45:47.091907 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-3ecab544-65c9-4a11-a4cc-6c8bbe994568 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Getting quotas for project eb857c94e3f6405baad84dfc45445b0d. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:45:47.095764 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-3ecab544-65c9-4a11-a4cc-6c8bbe994568 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Getting quotas for user d586af36267c475ab5af42a23ce3f1b1 and project eb857c94e3f6405baad84dfc45445b0d. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:45:47.117265 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3ecab544-65c9-4a11-a4cc-6c8bbe994568 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.049352 Aug 17 08:45:47.117904 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 355/723] 10.222.0.15 () {62 vars in 1200 bytes} [Wed Aug 17 08:45:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 17 08:45:48.713889 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-be88229e-4bd0-4c54-8027-1a9b1b43f81e req-6cff5c57-4088-4009-8974-f640581de5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7121f229-54ff-4621-a114-ae43449afcaa", "tag": "68dd16d1-6450-4d16-9965-73c35488b738"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:45:48.727857 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-be88229e-4bd0-4c54-8027-1a9b1b43f81e req-6cff5c57-4088-4009-8974-f640581de5f6 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:48.728730 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-be88229e-4bd0-4c54-8027-1a9b1b43f81e req-6cff5c57-4088-4009-8974-f640581de5f6 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:48.729361 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-be88229e-4bd0-4c54-8027-1a9b1b43f81e req-6cff5c57-4088-4009-8974-f640581de5f6 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:48.737922 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8fb70a52-4ef8-4d09-a2a8-7cac96350b7d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1889397837", "imageRef": "4467450c-a35c-42e3-af85-a13291b0b2aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d158ee5-e6fd-41a5-a1ba-f67b7981b1e8"}], "security_groups": [{"name": "tempest-securitygroup--1734151685"}], "key_name": "tempest-keypair-504629478", "user_data": "}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:45:48.742043 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-be88229e-4bd0-4c54-8027-1a9b1b43f81e req-6cff5c57-4088-4009-8974-f640581de5f6 service nova] Creating event network-changed:68dd16d1-6450-4d16-9965-73c35488b738 for instance 7121f229-54ff-4621-a114-ae43449afcaa on hv-cinder-85331 Aug 17 08:45:48.747394 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-be88229e-4bd0-4c54-8027-1a9b1b43f81e req-6cff5c57-4088-4009-8974-f640581de5f6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038395 Aug 17 08:45:48.748209 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 369/724] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:45:48.898455 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.network.neutron [None req-8fb70a52-4ef8-4d09-a2a8-7cac96350b7d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] validate_networks() for [('0d158ee5-e6fd-41a5-a1ba-f67b7981b1e8', None, None, None, None, None)] {{(pid=127298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 08:45:49.560017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-8fb70a52-4ef8-4d09-a2a8-7cac96350b7d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Flavor limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 08:45:49.563649 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-8fb70a52-4ef8-4d09-a2a8-7cac96350b7d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Image limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 08:45:49.564545 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-8fb70a52-4ef8-4d09-a2a8-7cac96350b7d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Flavor pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 08:45:49.564697 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-8fb70a52-4ef8-4d09-a2a8-7cac96350b7d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Image pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 08:45:49.565031 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-8fb70a52-4ef8-4d09-a2a8-7cac96350b7d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 08:45:49.574249 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8fb70a52-4ef8-4d09-a2a8-7cac96350b7d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:49.574996 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8fb70a52-4ef8-4d09-a2a8-7cac96350b7d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:49.575619 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8fb70a52-4ef8-4d09-a2a8-7cac96350b7d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:49.576774 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8fb70a52-4ef8-4d09-a2a8-7cac96350b7d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:49.577384 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8fb70a52-4ef8-4d09-a2a8-7cac96350b7d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:49.577973 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8fb70a52-4ef8-4d09-a2a8-7cac96350b7d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:49.600500 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-8fb70a52-4ef8-4d09-a2a8-7cac96350b7d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Getting quotas for project eb857c94e3f6405baad84dfc45445b0d. Resources: {'cores', 'instances', 'ram'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:45:49.604496 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-8fb70a52-4ef8-4d09-a2a8-7cac96350b7d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Getting quotas for user d586af36267c475ab5af42a23ce3f1b1 and project eb857c94e3f6405baad84dfc45445b0d. Resources: {'cores', 'instances', 'ram'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:45:49.617069 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8fb70a52-4ef8-4d09-a2a8-7cac96350b7d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Going to run 1 instances... {{(pid=127298) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 08:45:49.619592 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8fb70a52-4ef8-4d09-a2a8-7cac96350b7d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4467450c-a35c-42e3-af85-a13291b0b2aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 08:45:49.666317 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8fb70a52-4ef8-4d09-a2a8-7cac96350b7d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.933152 Aug 17 08:45:49.666957 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 356/725] 10.222.0.15 () {62 vars in 1188 bytes} [Wed Aug 17 08:45:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 17 08:45:49.678667 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c444c296-f55b-4502-9721-b1c45a9e69a2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:49.679351 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c444c296-f55b-4502-9721-b1c45a9e69a2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:49.738142 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c444c296-f55b-4502-9721-b1c45a9e69a2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:49.745971 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c444c296-f55b-4502-9721-b1c45a9e69a2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:49.747637 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c444c296-f55b-4502-9721-b1c45a9e69a2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:49.748685 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c444c296-f55b-4502-9721-b1c45a9e69a2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1281 microversion: 2.20 time: 0.074239 Aug 17 08:45:49.749240 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 370/726] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:45:49 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:45:50.771672 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0c999fe7-4002-4250-b540-77fd017a77c8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:50.773054 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0c999fe7-4002-4250-b540-77fd017a77c8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:50.780500 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0c999fe7-4002-4250-b540-77fd017a77c8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:50.780977 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0c999fe7-4002-4250-b540-77fd017a77c8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:50.781480 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0c999fe7-4002-4250-b540-77fd017a77c8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:50.782438 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0c999fe7-4002-4250-b540-77fd017a77c8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:50.783153 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0c999fe7-4002-4250-b540-77fd017a77c8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:50.783733 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0c999fe7-4002-4250-b540-77fd017a77c8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:50.866145 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0c999fe7-4002-4250-b540-77fd017a77c8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:50.874876 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0c999fe7-4002-4250-b540-77fd017a77c8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:50.876435 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0c999fe7-4002-4250-b540-77fd017a77c8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:50.877527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0c999fe7-4002-4250-b540-77fd017a77c8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1351 microversion: 2.20 time: 0.110472 Aug 17 08:45:50.878082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 357/727] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:45:50 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:45:51.900790 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-515cf18d-a8d2-4943-9429-15efc0dbdda1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:51.901395 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-515cf18d-a8d2-4943-9429-15efc0dbdda1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:51.909417 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-515cf18d-a8d2-4943-9429-15efc0dbdda1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:51.909892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-515cf18d-a8d2-4943-9429-15efc0dbdda1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:51.910323 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-515cf18d-a8d2-4943-9429-15efc0dbdda1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:51.910999 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-515cf18d-a8d2-4943-9429-15efc0dbdda1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:51.911443 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-515cf18d-a8d2-4943-9429-15efc0dbdda1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:51.911915 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-515cf18d-a8d2-4943-9429-15efc0dbdda1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:52.042710 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-515cf18d-a8d2-4943-9429-15efc0dbdda1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:52.051442 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-515cf18d-a8d2-4943-9429-15efc0dbdda1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:52.052976 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-515cf18d-a8d2-4943-9429-15efc0dbdda1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:52.054145 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-515cf18d-a8d2-4943-9429-15efc0dbdda1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1407 microversion: 2.20 time: 0.157501 Aug 17 08:45:52.064409 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 371/728] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:45:51 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:45:52.085525 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-841db032-e01d-46d0-8e9d-e3df7c9a2753 req-616be9ee-7299-4697-aab4-27379dad5e15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f579cfbe-0b43-4710-8ba4-ba221a36e20b", "tag": "fa872a89-5241-4d0c-9875-c10826245c65"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:45:52.096326 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-841db032-e01d-46d0-8e9d-e3df7c9a2753 req-616be9ee-7299-4697-aab4-27379dad5e15 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:52.096975 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-841db032-e01d-46d0-8e9d-e3df7c9a2753 req-616be9ee-7299-4697-aab4-27379dad5e15 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:52.097403 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-841db032-e01d-46d0-8e9d-e3df7c9a2753 req-616be9ee-7299-4697-aab4-27379dad5e15 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:52.108805 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-841db032-e01d-46d0-8e9d-e3df7c9a2753 req-616be9ee-7299-4697-aab4-27379dad5e15 service nova] Creating event network-changed:fa872a89-5241-4d0c-9875-c10826245c65 for instance f579cfbe-0b43-4710-8ba4-ba221a36e20b on hv-cinder-85331 Aug 17 08:45:52.113340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-841db032-e01d-46d0-8e9d-e3df7c9a2753 req-616be9ee-7299-4697-aab4-27379dad5e15 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031569 Aug 17 08:45:52.114118 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 358/729] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:45:52.919188 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a09a4f29-6ce5-4b46-af09-e67838d9f4a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:52.919762 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a09a4f29-6ce5-4b46-af09-e67838d9f4a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: db02d6b1-c272-4c1d-8700-3e096703b1d6] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:52.926003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a09a4f29-6ce5-4b46-af09-e67838d9f4a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:52.926464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a09a4f29-6ce5-4b46-af09-e67838d9f4a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:52.926884 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a09a4f29-6ce5-4b46-af09-e67838d9f4a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:52.927569 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a09a4f29-6ce5-4b46-af09-e67838d9f4a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:52.928011 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a09a4f29-6ce5-4b46-af09-e67838d9f4a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:52.928422 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a09a4f29-6ce5-4b46-af09-e67838d9f4a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:52.953012 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a09a4f29-6ce5-4b46-af09-e67838d9f4a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6/ips" status: 200 len: 149 microversion: 2.1 time: 0.038128 Aug 17 08:45:52.953571 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 372/730] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 08:45:52 2022] GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:45:52.965338 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-eb336513-cec4-4c01-b252-f8bd93376e9f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4b60026-271a-4507-9bf3-3b12a398c955"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:45:52.967896 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-eb336513-cec4-4c01-b252-f8bd93376e9f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: db02d6b1-c272-4c1d-8700-3e096703b1d6] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:52.974016 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eb336513-cec4-4c01-b252-f8bd93376e9f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:52.974493 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eb336513-cec4-4c01-b252-f8bd93376e9f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:52.974926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eb336513-cec4-4c01-b252-f8bd93376e9f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:52.975630 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eb336513-cec4-4c01-b252-f8bd93376e9f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:52.976079 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eb336513-cec4-4c01-b252-f8bd93376e9f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:52.976514 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-eb336513-cec4-4c01-b252-f8bd93376e9f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:53.053174 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-eb336513-cec4-4c01-b252-f8bd93376e9f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] HTTP exception thrown: Invalid volume: volume f4b60026-271a-4507-9bf3-3b12a398c955 is already attached to instances: 3e566e58-543c-4264-bee0-185da5050972 Aug 17 08:45:53.054903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-eb336513-cec4-4c01-b252-f8bd93376e9f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Request method failure captured: Aug 17 08:45:53.054903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: POST /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6/os-volume_attachments HTTP/1.1 Aug 17 08:45:53.054903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:45:53.054903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:45:53.054903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:45:53.054903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 74 Aug 17 08:45:53.054903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:45:53.054903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:45:53.054903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:45:53.054903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:45:53.054903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_KpFdcvpXRpf5-5Y1Bcdp25cETTaZP2GCfDiMsQtuC72_QvaOW9RGOTA8kn7uQkIZJZ1MZAapBPaWHtaHUw4ZxHYKXMP1ga8b2c-T6hV70Qk5k-OaBMweSR-NFttqfscTAbrcBgHODlMBBOScpWQJnArcc-Q8jX8Dn-V-35da8hxuVI Aug 17 08:45:53.054903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:45:53.054903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:45:53.054903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:45:53.054903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:45:53.054903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:45:53.054903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:45:53.054903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:45:53.054903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:45:53.054903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:45:53.054903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:45:53.056640 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_34b106e46b2c4fb292353a6176c9f699", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:45:53.056640 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:45:53.056640 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:45:53.056640 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:45:53.056640 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:45:53.056640 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:45:53.056640 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:45:53.056640 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: 49114d25c04144269e3eb88448e2c2ee Aug 17 08:45:53.056640 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:45:53.056640 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Aug 17 08:45:53.056640 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {"volumeAttachment": {"volumeId": "f4b60026-271a-4507-9bf3-3b12a398c955"}} Aug 17 08:45:53.056640 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:45:53.057656 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Invalid volume: volume f4b60026-271a-4507-9bf3-3b12a398c955 is already attached to instances: 3e566e58-543c-4264-bee0-185da5050972 Aug 17 08:45:53.057656 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'server_id': 'db02d6b1-c272-4c1d-8700-3e096703b1d6', 'body': {'volumeAttachment': {'volumeId': 'f4b60026-271a-4507-9bf3-3b12a398c955'}}} Aug 17 08:45:53.057656 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:45:53.057656 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:45:53.057656 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 08:45:53.057656 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 08:45:53.057656 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 08:45:53.057656 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 08:45:53.057656 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 17 08:45:53.057656 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 17 08:45:53.057656 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 17 08:45:53.057656 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 17 08:45:53.057656 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 17 08:45:53.057656 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 17 08:45:53.057656 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f4b60026-271a-4507-9bf3-3b12a398c955 is already attached to instances: 3e566e58-543c-4264-bee0-185da5050972 Aug 17 08:45:53.057656 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:45:53.057656 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:45:53.057656 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:45:53.057656 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:45:53.059800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:45:53.059800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:45:53.059800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:45:53.059800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:45:53.059800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:45:53.059800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:45:53.059800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 08:45:53.059800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 08:45:53.059800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 08:45:53.059800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 08:45:53.059800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 08:45:53.059800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 08:45:53.059800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 17 08:45:53.059800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 17 08:45:53.059800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f4b60026-271a-4507-9bf3-3b12a398c955 is already attached to instances: 3e566e58-543c-4264-bee0-185da5050972 Aug 17 08:45:53.059800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:45:53.059800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:45:53.059800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:45:53.059800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:45:53.059800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:45:53.061275 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:45:53.061275 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:45:53.061275 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:45:53.061275 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f4b60026-271a-4507-9bf3-3b12a398c955 is already attached to instances: 3e566e58-543c-4264-bee0-185da5050972 Aug 17 08:45:53.061275 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:45:53.061275 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-eb336513-cec4-4c01-b252-f8bd93376e9f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Returning 400 to user: Invalid volume: volume f4b60026-271a-4507-9bf3-3b12a398c955 is already attached to instances: 3e566e58-543c-4264-bee0-185da5050972 {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:45:53.061275 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-eb336513-cec4-4c01-b252-f8bd93376e9f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "POST /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095523 Aug 17 08:45:53.061275 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 359/731] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 08:45:52 2022] POST /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 08:45:53.066091 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0e54961e-91b2-45eb-ba41-78124389c74c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:53.066581 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0e54961e-91b2-45eb-ba41-78124389c74c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: db02d6b1-c272-4c1d-8700-3e096703b1d6] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:53.072531 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0e54961e-91b2-45eb-ba41-78124389c74c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:53.073008 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0e54961e-91b2-45eb-ba41-78124389c74c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:53.073437 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0e54961e-91b2-45eb-ba41-78124389c74c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:53.074119 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0e54961e-91b2-45eb-ba41-78124389c74c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:53.074566 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0e54961e-91b2-45eb-ba41-78124389c74c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:53.074997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0e54961e-91b2-45eb-ba41-78124389c74c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:53.079249 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:53.080906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b4e78648-a413-4483-8065-491f33e71dda tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:53.081547 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b4e78648-a413-4483-8065-491f33e71dda tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:53.088219 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b4e78648-a413-4483-8065-491f33e71dda tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:53.088799 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b4e78648-a413-4483-8065-491f33e71dda tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:53.089108 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b4e78648-a413-4483-8065-491f33e71dda tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:53.089831 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b4e78648-a413-4483-8065-491f33e71dda tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:53.090275 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b4e78648-a413-4483-8065-491f33e71dda tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:53.090689 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b4e78648-a413-4483-8065-491f33e71dda tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:53.095778 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:53.101480 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0e54961e-91b2-45eb-ba41-78124389c74c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: db02d6b1-c272-4c1d-8700-3e096703b1d6] Going to try to terminate instance {{(pid=127297) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 08:45:53.179276 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0e54961e-91b2-45eb-ba41-78124389c74c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "DELETE /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6" status: 204 len: 0 microversion: 2.1 time: 0.116545 Aug 17 08:45:53.180020 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 373/732] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:45:53 2022] DELETE /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 08:45:53.189078 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f468f59d-a4b2-4e66-8c1e-86d6b0eb759d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:53.189838 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f468f59d-a4b2-4e66-8c1e-86d6b0eb759d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: db02d6b1-c272-4c1d-8700-3e096703b1d6] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:53.195496 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f468f59d-a4b2-4e66-8c1e-86d6b0eb759d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:53.196021 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f468f59d-a4b2-4e66-8c1e-86d6b0eb759d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:53.196448 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f468f59d-a4b2-4e66-8c1e-86d6b0eb759d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:53.197119 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f468f59d-a4b2-4e66-8c1e-86d6b0eb759d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:53.197560 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f468f59d-a4b2-4e66-8c1e-86d6b0eb759d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:53.197973 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f468f59d-a4b2-4e66-8c1e-86d6b0eb759d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:53.223181 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b4e78648-a413-4483-8065-491f33e71dda tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:53.232286 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b4e78648-a413-4483-8065-491f33e71dda tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:53.233766 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b4e78648-a413-4483-8065-491f33e71dda tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:53.234852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b4e78648-a413-4483-8065-491f33e71dda tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1407 microversion: 2.20 time: 0.158205 Aug 17 08:45:53.235406 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 360/733] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:45:53 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 08:45:53.326987 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-f468f59d-a4b2-4e66-8c1e-86d6b0eb759d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:53.334377 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f468f59d-a4b2-4e66-8c1e-86d6b0eb759d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6" status: 200 len: 1680 microversion: 2.1 time: 0.149329 Aug 17 08:45:53.334953 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 374/734] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:53 2022] GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:45:54.256659 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-4775ac82-7718-4ffb-a6e1-b98dd1476663 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:54.257253 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-4775ac82-7718-4ffb-a6e1-b98dd1476663 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:54.264446 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4775ac82-7718-4ffb-a6e1-b98dd1476663 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:54.264918 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4775ac82-7718-4ffb-a6e1-b98dd1476663 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:54.265340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4775ac82-7718-4ffb-a6e1-b98dd1476663 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:54.266011 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4775ac82-7718-4ffb-a6e1-b98dd1476663 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:54.266452 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4775ac82-7718-4ffb-a6e1-b98dd1476663 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:54.266863 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4775ac82-7718-4ffb-a6e1-b98dd1476663 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:54.356985 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-30831987-f991-4489-8225-d3a3cbb46bca tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:54.357689 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-30831987-f991-4489-8225-d3a3cbb46bca tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: db02d6b1-c272-4c1d-8700-3e096703b1d6] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:54.364049 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-30831987-f991-4489-8225-d3a3cbb46bca tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:54.364528 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-30831987-f991-4489-8225-d3a3cbb46bca tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:54.364987 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-30831987-f991-4489-8225-d3a3cbb46bca tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:54.365676 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-30831987-f991-4489-8225-d3a3cbb46bca tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:54.366127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-30831987-f991-4489-8225-d3a3cbb46bca tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:54.366543 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-30831987-f991-4489-8225-d3a3cbb46bca tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:54.397533 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-4775ac82-7718-4ffb-a6e1-b98dd1476663 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:54.405662 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-4775ac82-7718-4ffb-a6e1-b98dd1476663 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:54.407160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-4775ac82-7718-4ffb-a6e1-b98dd1476663 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:54.408287 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-4775ac82-7718-4ffb-a6e1-b98dd1476663 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1407 microversion: 2.20 time: 0.155478 Aug 17 08:45:54.408844 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 361/735] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:45:54 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:45:54.491935 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-30831987-f991-4489-8225-d3a3cbb46bca tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:54.500029 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-30831987-f991-4489-8225-d3a3cbb46bca tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6" status: 200 len: 1680 microversion: 2.1 time: 0.147283 Aug 17 08:45:54.500603 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 375/736] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:54 2022] GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6 => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:45:55.430494 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ef0fc030-c128-4dbe-b991-39c0e5f29cf4 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:55.431015 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ef0fc030-c128-4dbe-b991-39c0e5f29cf4 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:55.437551 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ef0fc030-c128-4dbe-b991-39c0e5f29cf4 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:55.438028 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ef0fc030-c128-4dbe-b991-39c0e5f29cf4 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:55.438482 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ef0fc030-c128-4dbe-b991-39c0e5f29cf4 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:55.439166 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ef0fc030-c128-4dbe-b991-39c0e5f29cf4 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:55.439630 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ef0fc030-c128-4dbe-b991-39c0e5f29cf4 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:55.440040 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ef0fc030-c128-4dbe-b991-39c0e5f29cf4 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:55.521986 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-cb80de31-fb50-4a80-9b75-c8ad2c76a09e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:55.523208 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-cb80de31-fb50-4a80-9b75-c8ad2c76a09e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: db02d6b1-c272-4c1d-8700-3e096703b1d6] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:55.531338 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cb80de31-fb50-4a80-9b75-c8ad2c76a09e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:55.532186 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cb80de31-fb50-4a80-9b75-c8ad2c76a09e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:55.532780 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cb80de31-fb50-4a80-9b75-c8ad2c76a09e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:55.533667 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cb80de31-fb50-4a80-9b75-c8ad2c76a09e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:55.534302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cb80de31-fb50-4a80-9b75-c8ad2c76a09e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:55.535027 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cb80de31-fb50-4a80-9b75-c8ad2c76a09e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:55.578650 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ef0fc030-c128-4dbe-b991-39c0e5f29cf4 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:55.588341 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ef0fc030-c128-4dbe-b991-39c0e5f29cf4 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:55.589891 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ef0fc030-c128-4dbe-b991-39c0e5f29cf4 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:55.595856 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ef0fc030-c128-4dbe-b991-39c0e5f29cf4 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1407 microversion: 2.20 time: 0.169369 Aug 17 08:45:55.596591 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 362/737] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:45:55 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:45:55.625758 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-cb80de31-fb50-4a80-9b75-c8ad2c76a09e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:55.633941 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-cb80de31-fb50-4a80-9b75-c8ad2c76a09e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6" status: 200 len: 1613 microversion: 2.1 time: 0.116645 Aug 17 08:45:55.634517 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 376/738] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:55 2022] GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6 => generated 1613 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:45:55.920451 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-a5451ab6-4c57-411d-87a8-7f57fd38c5fe req-00560d48-3c5e-4d81-983d-2758217a53dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db02d6b1-c272-4c1d-8700-3e096703b1d6", "name": "network-vif-deleted", "tag": "a648f16a-8281-46de-a07c-3ad62496891a"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:45:55.931958 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-a5451ab6-4c57-411d-87a8-7f57fd38c5fe req-00560d48-3c5e-4d81-983d-2758217a53dd service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:55.932440 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-a5451ab6-4c57-411d-87a8-7f57fd38c5fe req-00560d48-3c5e-4d81-983d-2758217a53dd service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:55.932869 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-a5451ab6-4c57-411d-87a8-7f57fd38c5fe req-00560d48-3c5e-4d81-983d-2758217a53dd service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:55.948758 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-a5451ab6-4c57-411d-87a8-7f57fd38c5fe req-00560d48-3c5e-4d81-983d-2758217a53dd service nova] Creating event network-vif-deleted:a648f16a-8281-46de-a07c-3ad62496891a for instance db02d6b1-c272-4c1d-8700-3e096703b1d6 on hv-cinder-85331 Aug 17 08:45:55.955220 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-a5451ab6-4c57-411d-87a8-7f57fd38c5fe req-00560d48-3c5e-4d81-983d-2758217a53dd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039367 Aug 17 08:45:55.956079 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 363/739] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:45:56.618436 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d1a843fa-21c5-44ba-b6aa-cfd9609c1427 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:56.619033 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d1a843fa-21c5-44ba-b6aa-cfd9609c1427 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:56.625476 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d1a843fa-21c5-44ba-b6aa-cfd9609c1427 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:56.625957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d1a843fa-21c5-44ba-b6aa-cfd9609c1427 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:56.626386 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d1a843fa-21c5-44ba-b6aa-cfd9609c1427 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:56.627137 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d1a843fa-21c5-44ba-b6aa-cfd9609c1427 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:56.627617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d1a843fa-21c5-44ba-b6aa-cfd9609c1427 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:56.628038 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d1a843fa-21c5-44ba-b6aa-cfd9609c1427 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:56.656067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e5d38513-ead7-4cff-99a9-cdaee34acb26 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:56.656882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e5d38513-ead7-4cff-99a9-cdaee34acb26 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: db02d6b1-c272-4c1d-8700-3e096703b1d6] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:56.663159 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e5d38513-ead7-4cff-99a9-cdaee34acb26 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:56.663660 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e5d38513-ead7-4cff-99a9-cdaee34acb26 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:56.664268 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e5d38513-ead7-4cff-99a9-cdaee34acb26 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:56.664943 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e5d38513-ead7-4cff-99a9-cdaee34acb26 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:56.665384 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e5d38513-ead7-4cff-99a9-cdaee34acb26 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:56.665799 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e5d38513-ead7-4cff-99a9-cdaee34acb26 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:56.679712 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-e5d38513-ead7-4cff-99a9-cdaee34acb26 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] HTTP exception thrown: Instance db02d6b1-c272-4c1d-8700-3e096703b1d6 could not be found. Aug 17 08:45:56.681245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e5d38513-ead7-4cff-99a9-cdaee34acb26 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Request method failure captured: Aug 17 08:45:56.681245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6 HTTP/1.1 Aug 17 08:45:56.681245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:45:56.681245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:45:56.681245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:45:56.681245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:45:56.681245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:45:56.681245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:45:56.681245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:45:56.681245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:45:56.681245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_KpFdcvpXRpf5-5Y1Bcdp25cETTaZP2GCfDiMsQtuC72_QvaOW9RGOTA8kn7uQkIZJZ1MZAapBPaWHtaHUw4ZxHYKXMP1ga8b2c-T6hV70Qk5k-OaBMweSR-NFttqfscTAbrcBgHODlMBBOScpWQJnArcc-Q8jX8Dn-V-35da8hxuVI Aug 17 08:45:56.681245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:45:56.681245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:45:56.681245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:45:56.681245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:45:56.681245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:45:56.681245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:45:56.681245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:45:56.681245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:45:56.681245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:45:56.681245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:45:56.682924 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_34b106e46b2c4fb292353a6176c9f699", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:45:56.682924 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:45:56.682924 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:45:56.682924 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:45:56.682924 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:45:56.682924 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:45:56.682924 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:45:56.682924 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: 49114d25c04144269e3eb88448e2c2ee Aug 17 08:45:56.682924 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:45:56.682924 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:45:56.682924 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Instance db02d6b1-c272-4c1d-8700-3e096703b1d6 could not be found. Aug 17 08:45:56.682924 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'id': 'db02d6b1-c272-4c1d-8700-3e096703b1d6'} Aug 17 08:45:56.684020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:45:56.684020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:45:56.684020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:45:56.684020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:45:56.684020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:45:56.684020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:45:56.684020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:45:56.684020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:45:56.684020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:45:56.684020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:45:56.684020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db02d6b1-c272-4c1d-8700-3e096703b1d6 could not be found. Aug 17 08:45:56.684020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:45:56.684020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:45:56.684020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:45:56.684020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:45:56.684020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:45:56.684020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:45:56.684020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:45:56.684020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:45:56.684020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:45:56.685519 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:45:56.685519 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:45:56.685519 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:45:56.685519 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:45:56.685519 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:45:56.685519 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:45:56.685519 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:45:56.685519 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db02d6b1-c272-4c1d-8700-3e096703b1d6 could not be found. Aug 17 08:45:56.685519 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:45:56.685519 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:45:56.685519 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:45:56.685519 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:45:56.685519 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:45:56.685519 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:45:56.685519 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:45:56.685519 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:45:56.685519 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db02d6b1-c272-4c1d-8700-3e096703b1d6 could not be found. Aug 17 08:45:56.685519 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:45:56.687667 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e5d38513-ead7-4cff-99a9-cdaee34acb26 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Returning 404 to user: Instance db02d6b1-c272-4c1d-8700-3e096703b1d6 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:45:56.688512 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e5d38513-ead7-4cff-99a9-cdaee34acb26 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6" status: 404 len: 111 microversion: 2.1 time: 0.037104 Aug 17 08:45:56.689073 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 364/740] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:56 2022] GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 08:45:56.697699 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ab6639ef-5a47-4802-8b9d-2ac25dcf8bf2 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '.version_select at 0x7f3f85240310>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:56.722688 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ab6639ef-5a47-4802-8b9d-2ac25dcf8bf2 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-455366047" status: 202 len: 0 microversion: 2.1 time: 0.029063 Aug 17 08:45:56.723353 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 365/741] 10.222.0.15 () {58 vars in 1218 bytes} [Wed Aug 17 08:45:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-455366047 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 08:45:56.775022 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d1a843fa-21c5-44ba-b6aa-cfd9609c1427 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:56.784128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d1a843fa-21c5-44ba-b6aa-cfd9609c1427 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:56.785555 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d1a843fa-21c5-44ba-b6aa-cfd9609c1427 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:56.786645 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d1a843fa-21c5-44ba-b6aa-cfd9609c1427 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1407 microversion: 2.20 time: 0.172291 Aug 17 08:45:56.787275 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 377/742] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:45:56 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:45:57.385719 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-17e11d84-0499-4ea5-8800-91ac086eceae tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:57.386199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-17e11d84-0499-4ea5-8800-91ac086eceae tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:57.391997 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-17e11d84-0499-4ea5-8800-91ac086eceae tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:57.392466 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-17e11d84-0499-4ea5-8800-91ac086eceae tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:57.392891 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-17e11d84-0499-4ea5-8800-91ac086eceae tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:57.393558 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-17e11d84-0499-4ea5-8800-91ac086eceae tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:57.394000 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-17e11d84-0499-4ea5-8800-91ac086eceae tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:57.394409 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-17e11d84-0499-4ea5-8800-91ac086eceae tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:57.473213 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-17e11d84-0499-4ea5-8800-91ac086eceae tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lazy-loading 'services' on Instance uuid 3e566e58-543c-4264-bee0-185da5050972 {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:45:57.549057 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-17e11d84-0499-4ea5-8800-91ac086eceae tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972/os-volume_attachments/f4b60026-271a-4507-9bf3-3b12a398c955" status: 202 len: 0 microversion: 2.1 time: 0.167033 Aug 17 08:45:57.549637 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 366/743] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 08:45:57 2022] DELETE /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972/os-volume_attachments/f4b60026-271a-4507-9bf3-3b12a398c955 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:45:57.558121 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-cf425850-78cb-4507-bcd8-1d63893b6446 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:57.560996 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-cf425850-78cb-4507-bcd8-1d63893b6446 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:57.566839 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cf425850-78cb-4507-bcd8-1d63893b6446 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:57.567322 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cf425850-78cb-4507-bcd8-1d63893b6446 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:57.567791 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cf425850-78cb-4507-bcd8-1d63893b6446 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:57.568474 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cf425850-78cb-4507-bcd8-1d63893b6446 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:57.568926 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cf425850-78cb-4507-bcd8-1d63893b6446 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:57.569348 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cf425850-78cb-4507-bcd8-1d63893b6446 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:57.603195 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-cf425850-78cb-4507-bcd8-1d63893b6446 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048780 Aug 17 08:45:57.603817 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 378/744] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 08:45:57 2022] GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:45:57.809655 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0a8820e5-d249-4cdf-ae89-33c89c6eca2d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:57.810359 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0a8820e5-d249-4cdf-ae89-33c89c6eca2d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:57.813339 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:57.817448 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0a8820e5-d249-4cdf-ae89-33c89c6eca2d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:57.817920 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0a8820e5-d249-4cdf-ae89-33c89c6eca2d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:57.818373 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0a8820e5-d249-4cdf-ae89-33c89c6eca2d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:57.819043 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0a8820e5-d249-4cdf-ae89-33c89c6eca2d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:57.819482 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0a8820e5-d249-4cdf-ae89-33c89c6eca2d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:57.819923 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0a8820e5-d249-4cdf-ae89-33c89c6eca2d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:57.963008 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0a8820e5-d249-4cdf-ae89-33c89c6eca2d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:57.972693 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0a8820e5-d249-4cdf-ae89-33c89c6eca2d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:57.974345 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0a8820e5-d249-4cdf-ae89-33c89c6eca2d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:57.975660 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0a8820e5-d249-4cdf-ae89-33c89c6eca2d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1407 microversion: 2.20 time: 0.170594 Aug 17 08:45:57.976316 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 367/745] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:45:57 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:45:58.137058 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-763e26ab-8730-44aa-b505-32c4deb3a68f req-3a11f33b-5e59-44c4-8710-f5e6e52391b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f579cfbe-0b43-4710-8ba4-ba221a36e20b", "name": "network-vif-plugged", "status": "completed", "tag": "fa872a89-5241-4d0c-9875-c10826245c65"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:45:58.146785 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-763e26ab-8730-44aa-b505-32c4deb3a68f req-3a11f33b-5e59-44c4-8710-f5e6e52391b3 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:58.147566 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-763e26ab-8730-44aa-b505-32c4deb3a68f req-3a11f33b-5e59-44c4-8710-f5e6e52391b3 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:58.147687 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-763e26ab-8730-44aa-b505-32c4deb3a68f req-3a11f33b-5e59-44c4-8710-f5e6e52391b3 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:58.159334 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-763e26ab-8730-44aa-b505-32c4deb3a68f req-3a11f33b-5e59-44c4-8710-f5e6e52391b3 service nova] Creating event network-vif-plugged:fa872a89-5241-4d0c-9875-c10826245c65 for instance f579cfbe-0b43-4710-8ba4-ba221a36e20b on hv-cinder-85331 Aug 17 08:45:58.164062 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-763e26ab-8730-44aa-b505-32c4deb3a68f req-3a11f33b-5e59-44c4-8710-f5e6e52391b3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031139 Aug 17 08:45:58.164648 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 379/746] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:45:58.616147 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1bedfffe-bb3b-4f10-8c8e-607169e4937c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:58.618349 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1bedfffe-bb3b-4f10-8c8e-607169e4937c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:58.624896 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1bedfffe-bb3b-4f10-8c8e-607169e4937c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:58.625373 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1bedfffe-bb3b-4f10-8c8e-607169e4937c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:58.625801 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1bedfffe-bb3b-4f10-8c8e-607169e4937c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:58.626468 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1bedfffe-bb3b-4f10-8c8e-607169e4937c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:58.626907 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1bedfffe-bb3b-4f10-8c8e-607169e4937c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:58.627424 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1bedfffe-bb3b-4f10-8c8e-607169e4937c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:58.656203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1bedfffe-bb3b-4f10-8c8e-607169e4937c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043980 Aug 17 08:45:58.656762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 368/747] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 08:45:58 2022] GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:45:59.000035 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6fceda1c-86ae-48da-a9d6-1db8d116dcb1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:59.000728 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6fceda1c-86ae-48da-a9d6-1db8d116dcb1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:59.006734 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6fceda1c-86ae-48da-a9d6-1db8d116dcb1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:59.007212 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6fceda1c-86ae-48da-a9d6-1db8d116dcb1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:59.007702 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6fceda1c-86ae-48da-a9d6-1db8d116dcb1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:59.008387 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6fceda1c-86ae-48da-a9d6-1db8d116dcb1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:59.008838 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6fceda1c-86ae-48da-a9d6-1db8d116dcb1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:59.009259 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6fceda1c-86ae-48da-a9d6-1db8d116dcb1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:59.138749 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6fceda1c-86ae-48da-a9d6-1db8d116dcb1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:59.146761 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6fceda1c-86ae-48da-a9d6-1db8d116dcb1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:59.148377 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6fceda1c-86ae-48da-a9d6-1db8d116dcb1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:45:59.149501 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6fceda1c-86ae-48da-a9d6-1db8d116dcb1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1407 microversion: 2.20 time: 0.154433 Aug 17 08:45:59.150053 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 380/748] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:45:58 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 08:45:59.668507 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1017bf40-fb17-491a-a313-2548fc5a938a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:59.670608 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1017bf40-fb17-491a-a313-2548fc5a938a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:59.672888 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:59.673532 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=10 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:59.679079 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1017bf40-fb17-491a-a313-2548fc5a938a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:59.679574 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1017bf40-fb17-491a-a313-2548fc5a938a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:59.679995 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1017bf40-fb17-491a-a313-2548fc5a938a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:59.680672 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1017bf40-fb17-491a-a313-2548fc5a938a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:59.681114 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1017bf40-fb17-491a-a313-2548fc5a938a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:59.681525 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1017bf40-fb17-491a-a313-2548fc5a938a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:59.710629 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1017bf40-fb17-491a-a313-2548fc5a938a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046726 Aug 17 08:45:59.711189 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 369/749] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 08:45:59 2022] GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 17 08:45:59.771455 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-cc38bca0-3325-458a-9ecb-fc87def4895d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:59.771958 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-cc38bca0-3325-458a-9ecb-fc87def4895d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:59.773879 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:45:59.779147 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cc38bca0-3325-458a-9ecb-fc87def4895d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:59.779644 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cc38bca0-3325-458a-9ecb-fc87def4895d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:59.780072 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cc38bca0-3325-458a-9ecb-fc87def4895d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:59.780772 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cc38bca0-3325-458a-9ecb-fc87def4895d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:59.781213 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cc38bca0-3325-458a-9ecb-fc87def4895d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:59.781626 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cc38bca0-3325-458a-9ecb-fc87def4895d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:59.807020 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-cc38bca0-3325-458a-9ecb-fc87def4895d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] Going to try to terminate instance {{(pid=127297) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 08:45:59.878816 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-cc38bca0-3325-458a-9ecb-fc87def4895d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972" status: 204 len: 0 microversion: 2.1 time: 0.110643 Aug 17 08:45:59.879453 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 381/750] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:45:59 2022] DELETE /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 08:45:59.887802 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-19ffe011-1380-4a64-9aac-60c5f9660a11 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:45:59.888433 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-19ffe011-1380-4a64-9aac-60c5f9660a11 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:45:59.894275 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-19ffe011-1380-4a64-9aac-60c5f9660a11 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:59.894787 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-19ffe011-1380-4a64-9aac-60c5f9660a11 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:59.895214 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-19ffe011-1380-4a64-9aac-60c5f9660a11 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:45:59.895927 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-19ffe011-1380-4a64-9aac-60c5f9660a11 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:45:59.896377 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-19ffe011-1380-4a64-9aac-60c5f9660a11 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:45:59.896791 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-19ffe011-1380-4a64-9aac-60c5f9660a11 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:00.023517 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-19ffe011-1380-4a64-9aac-60c5f9660a11 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:00.031770 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-19ffe011-1380-4a64-9aac-60c5f9660a11 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972" status: 200 len: 1681 microversion: 2.1 time: 0.147969 Aug 17 08:46:00.032353 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 370/751] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:45:59 2022] GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:46:00.173331 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-9554583f-eea0-4b7b-9e7a-b93a4d589727 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:00.174010 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-9554583f-eea0-4b7b-9e7a-b93a4d589727 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:00.176380 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:46:00.181897 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9554583f-eea0-4b7b-9e7a-b93a4d589727 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:00.182373 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9554583f-eea0-4b7b-9e7a-b93a4d589727 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:00.182799 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9554583f-eea0-4b7b-9e7a-b93a4d589727 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:00.183528 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9554583f-eea0-4b7b-9e7a-b93a4d589727 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:00.183993 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9554583f-eea0-4b7b-9e7a-b93a4d589727 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:00.184407 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9554583f-eea0-4b7b-9e7a-b93a4d589727 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:00.317880 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-9554583f-eea0-4b7b-9e7a-b93a4d589727 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:00.326480 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-9554583f-eea0-4b7b-9e7a-b93a4d589727 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:00.327984 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-9554583f-eea0-4b7b-9e7a-b93a4d589727 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:00.329127 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-9554583f-eea0-4b7b-9e7a-b93a4d589727 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1600 microversion: 2.20 time: 0.160305 Aug 17 08:46:00.329689 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 382/752] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:46:00 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:46:00.350931 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b7368172-575a-47d5-ac34-7ad88db4aaba tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:00.351410 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b7368172-575a-47d5-ac34-7ad88db4aaba tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:00.357463 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b7368172-575a-47d5-ac34-7ad88db4aaba tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:00.357931 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b7368172-575a-47d5-ac34-7ad88db4aaba tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:00.358354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b7368172-575a-47d5-ac34-7ad88db4aaba tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:00.359021 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b7368172-575a-47d5-ac34-7ad88db4aaba tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:00.359462 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b7368172-575a-47d5-ac34-7ad88db4aaba tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:00.359895 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b7368172-575a-47d5-ac34-7ad88db4aaba tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:00.434276 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b7368172-575a-47d5-ac34-7ad88db4aaba tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.087125 Aug 17 08:46:00.434866 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 371/753] 10.222.0.15 () {60 vars in 1316 bytes} [Wed Aug 17 08:46:00 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 08:46:01.053427 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-88d80698-67ce-4989-a626-c89c6d75bd89 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:01.054346 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-88d80698-67ce-4989-a626-c89c6d75bd89 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:01.060897 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-88d80698-67ce-4989-a626-c89c6d75bd89 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:01.061547 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-88d80698-67ce-4989-a626-c89c6d75bd89 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:01.061992 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-88d80698-67ce-4989-a626-c89c6d75bd89 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:01.062683 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-88d80698-67ce-4989-a626-c89c6d75bd89 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:01.063138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-88d80698-67ce-4989-a626-c89c6d75bd89 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:01.063577 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-88d80698-67ce-4989-a626-c89c6d75bd89 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:01.197168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-88d80698-67ce-4989-a626-c89c6d75bd89 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:01.205429 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-88d80698-67ce-4989-a626-c89c6d75bd89 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972" status: 200 len: 1681 microversion: 2.1 time: 0.155833 Aug 17 08:46:01.206322 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 383/754] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:46:01 2022] GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:46:01.600939 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-2677ed9e-c98b-4183-b73c-4bb6a6755f37 req-bc6ab700-33dd-4816-9485-364870a527d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f579cfbe-0b43-4710-8ba4-ba221a36e20b", "tag": "fa872a89-5241-4d0c-9875-c10826245c65"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:46:01.611675 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-2677ed9e-c98b-4183-b73c-4bb6a6755f37 req-bc6ab700-33dd-4816-9485-364870a527d0 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:01.612151 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-2677ed9e-c98b-4183-b73c-4bb6a6755f37 req-bc6ab700-33dd-4816-9485-364870a527d0 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:01.612571 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-2677ed9e-c98b-4183-b73c-4bb6a6755f37 req-bc6ab700-33dd-4816-9485-364870a527d0 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:01.623613 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-2677ed9e-c98b-4183-b73c-4bb6a6755f37 req-bc6ab700-33dd-4816-9485-364870a527d0 service nova] Creating event network-changed:fa872a89-5241-4d0c-9875-c10826245c65 for instance f579cfbe-0b43-4710-8ba4-ba221a36e20b on hv-cinder-85331 Aug 17 08:46:01.628367 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-2677ed9e-c98b-4183-b73c-4bb6a6755f37 req-bc6ab700-33dd-4816-9485-364870a527d0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031540 Aug 17 08:46:01.628943 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 372/755] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:46:02.231257 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-11161ce8-7130-4af0-98a8-969654b501a3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:02.232564 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-11161ce8-7130-4af0-98a8-969654b501a3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:02.241139 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-11161ce8-7130-4af0-98a8-969654b501a3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:02.242230 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-11161ce8-7130-4af0-98a8-969654b501a3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:02.242830 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-11161ce8-7130-4af0-98a8-969654b501a3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:02.243762 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-11161ce8-7130-4af0-98a8-969654b501a3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:02.244218 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-11161ce8-7130-4af0-98a8-969654b501a3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:02.245378 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-11161ce8-7130-4af0-98a8-969654b501a3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:02.477257 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-11161ce8-7130-4af0-98a8-969654b501a3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:02.485607 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-11161ce8-7130-4af0-98a8-969654b501a3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972" status: 200 len: 1681 microversion: 2.1 time: 0.262278 Aug 17 08:46:02.486480 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 384/756] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:46:02 2022] GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972 => generated 1681 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:46:03.507195 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2f63b6ab-4b8f-4782-866b-b047487994cf tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:03.507905 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2f63b6ab-4b8f-4782-866b-b047487994cf tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:03.514508 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2f63b6ab-4b8f-4782-866b-b047487994cf tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:03.515186 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2f63b6ab-4b8f-4782-866b-b047487994cf tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:03.515843 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2f63b6ab-4b8f-4782-866b-b047487994cf tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:03.516530 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2f63b6ab-4b8f-4782-866b-b047487994cf tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:03.516974 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2f63b6ab-4b8f-4782-866b-b047487994cf tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:03.517573 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2f63b6ab-4b8f-4782-866b-b047487994cf tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:03.550045 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2f63b6ab-4b8f-4782-866b-b047487994cf tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:03.550523 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2f63b6ab-4b8f-4782-866b-b047487994cf tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:03.550951 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2f63b6ab-4b8f-4782-866b-b047487994cf tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:03.551401 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-2f63b6ab-4b8f-4782-866b-b047487994cf tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lazy-loading 'fault' on Instance uuid 3e566e58-543c-4264-bee0-185da5050972 {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:46:03.594636 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2f63b6ab-4b8f-4782-866b-b047487994cf tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:03.602659 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2f63b6ab-4b8f-4782-866b-b047487994cf tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972" status: 200 len: 1331 microversion: 2.1 time: 0.100078 Aug 17 08:46:03.613080 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 373/757] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:46:03 2022] GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972 => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:46:03.643773 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-d29d319b-7901-49d9-a69d-6dde41d7e6e7 req-3243e9de-806d-454b-8b0d-4061231efe8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e566e58-543c-4264-bee0-185da5050972", "name": "network-vif-deleted", "tag": "1bba73d1-dc37-4c6f-a150-b9806ac22bda"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:46:03.653175 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-d29d319b-7901-49d9-a69d-6dde41d7e6e7 req-3243e9de-806d-454b-8b0d-4061231efe8e service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:03.653791 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-d29d319b-7901-49d9-a69d-6dde41d7e6e7 req-3243e9de-806d-454b-8b0d-4061231efe8e service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:03.654286 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-d29d319b-7901-49d9-a69d-6dde41d7e6e7 req-3243e9de-806d-454b-8b0d-4061231efe8e service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:03.665198 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-d29d319b-7901-49d9-a69d-6dde41d7e6e7 req-3243e9de-806d-454b-8b0d-4061231efe8e service nova] Creating event network-vif-deleted:1bba73d1-dc37-4c6f-a150-b9806ac22bda for instance 3e566e58-543c-4264-bee0-185da5050972 on hv-cinder-85331 Aug 17 08:46:03.674121 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-d29d319b-7901-49d9-a69d-6dde41d7e6e7 req-3243e9de-806d-454b-8b0d-4061231efe8e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034341 Aug 17 08:46:03.678165 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 385/758] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:46:04.624612 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e4a2c56c-8d39-4927-8065-c125bd83fd54 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:04.625212 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e4a2c56c-8d39-4927-8065-c125bd83fd54 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:04.631527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e4a2c56c-8d39-4927-8065-c125bd83fd54 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:04.632054 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e4a2c56c-8d39-4927-8065-c125bd83fd54 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:04.632479 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e4a2c56c-8d39-4927-8065-c125bd83fd54 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:04.633144 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e4a2c56c-8d39-4927-8065-c125bd83fd54 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:04.633585 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e4a2c56c-8d39-4927-8065-c125bd83fd54 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:04.633999 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e4a2c56c-8d39-4927-8065-c125bd83fd54 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:04.647365 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-e4a2c56c-8d39-4927-8065-c125bd83fd54 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] HTTP exception thrown: Instance 3e566e58-543c-4264-bee0-185da5050972 could not be found. Aug 17 08:46:04.648970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e4a2c56c-8d39-4927-8065-c125bd83fd54 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Request method failure captured: Aug 17 08:46:04.648970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972 HTTP/1.1 Aug 17 08:46:04.648970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:46:04.648970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:46:04.648970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:46:04.648970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:46:04.648970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:46:04.648970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:46:04.648970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:46:04.648970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:46:04.648970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_KpFdcvpXRpf5-5Y1Bcdp25cETTaZP2GCfDiMsQtuC72_QvaOW9RGOTA8kn7uQkIZJZ1MZAapBPaWHtaHUw4ZxHYKXMP1ga8b2c-T6hV70Qk5k-OaBMweSR-NFttqfscTAbrcBgHODlMBBOScpWQJnArcc-Q8jX8Dn-V-35da8hxuVI Aug 17 08:46:04.648970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:46:04.648970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:46:04.648970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:46:04.648970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:46:04.648970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:46:04.648970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:46:04.648970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:46:04.648970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:46:04.648970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:46:04.648970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:46:04.650603 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_34b106e46b2c4fb292353a6176c9f699", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:46:04.650603 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:46:04.650603 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:46:04.650603 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:46:04.650603 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:46:04.650603 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:46:04.650603 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:46:04.650603 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: 49114d25c04144269e3eb88448e2c2ee Aug 17 08:46:04.650603 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:46:04.650603 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:46:04.650603 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Instance 3e566e58-543c-4264-bee0-185da5050972 could not be found. Aug 17 08:46:04.650603 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'id': '3e566e58-543c-4264-bee0-185da5050972'} Aug 17 08:46:04.651457 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:46:04.651457 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:46:04.651457 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:46:04.651457 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:46:04.651457 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:46:04.651457 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:46:04.651457 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:46:04.651457 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:46:04.651457 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:46:04.651457 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:46:04.651457 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e566e58-543c-4264-bee0-185da5050972 could not be found. Aug 17 08:46:04.651457 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:46:04.651457 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:46:04.651457 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:46:04.651457 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:46:04.651457 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:46:04.651457 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:46:04.651457 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:46:04.651457 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:46:04.651457 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:46:04.652994 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:46:04.652994 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:46:04.652994 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:46:04.652994 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:46:04.652994 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:46:04.652994 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:46:04.652994 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:46:04.652994 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e566e58-543c-4264-bee0-185da5050972 could not be found. Aug 17 08:46:04.652994 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:46:04.652994 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:46:04.652994 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:46:04.652994 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:46:04.652994 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:46:04.652994 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:46:04.652994 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:46:04.652994 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:46:04.652994 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e566e58-543c-4264-bee0-185da5050972 could not be found. Aug 17 08:46:04.652994 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:46:04.654370 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e4a2c56c-8d39-4927-8065-c125bd83fd54 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Returning 404 to user: Instance 3e566e58-543c-4264-bee0-185da5050972 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:46:04.654370 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e4a2c56c-8d39-4927-8065-c125bd83fd54 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972" status: 404 len: 111 microversion: 2.1 time: 0.030097 Aug 17 08:46:04.654370 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 374/759] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:46:04 2022] GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:46:04.659847 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-021792fa-13c9-43f4-b692-d3d9626645c0 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '.version_select at 0x7f3f8530ce50>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:04.677429 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-021792fa-13c9-43f4-b692-d3d9626645c0 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374923207" status: 202 len: 0 microversion: 2.1 time: 0.022099 Aug 17 08:46:04.677968 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 386/760] 10.222.0.15 () {58 vars in 1221 bytes} [Wed Aug 17 08:46:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374923207 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:46:05.281749 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e3a30ba4-bb4c-46aa-8637-306400e4fdcd tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Action: 'create', calling method: .version_select at 0x7f3f851dfee0>, body: {"keypair": {"name": "tempest-keypair-2140846401", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdbv1i4EmXHC+YJWgNBq5VnWMvlyFVIl7NehpKzY7psA0vPAFIklahst+5pSwXgNyR1uOo7jyS7RH+4dFC+1fTYMt2/5BYY4EjF2XBYU+rjFGWeg52uRWD9bcMyA8zKZw=="}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:46:05.298078 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-e3a30ba4-bb4c-46aa-8637-306400e4fdcd tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Getting quotas for project 34b106e46b2c4fb292353a6176c9f699. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:46:05.301842 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-e3a30ba4-bb4c-46aa-8637-306400e4fdcd tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Getting quotas for user 49114d25c04144269e3eb88448e2c2ee and project 34b106e46b2c4fb292353a6176c9f699. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:46:05.322366 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e3a30ba4-bb4c-46aa-8637-306400e4fdcd tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044488 Aug 17 08:46:05.322964 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 375/761] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 08:46:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:46:06.784773 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-832ef776-96af-4476-b3a2-4b715e1d036d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-421378621", "imageRef": "4467450c-a35c-42e3-af85-a13291b0b2aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "57fc802a-439c-414a-9558-62dc475889bd"}], "security_groups": [{"name": "tempest-securitygroup--1921894385"}], "key_name": "tempest-keypair-2140846401", "user_data": "}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:46:06.886719 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.network.neutron [None req-832ef776-96af-4476-b3a2-4b715e1d036d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] validate_networks() for [('57fc802a-439c-414a-9558-62dc475889bd', None, None, None, None, None)] {{(pid=127297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 08:46:07.249262 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-832ef776-96af-4476-b3a2-4b715e1d036d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Flavor limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 08:46:07.249685 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-832ef776-96af-4476-b3a2-4b715e1d036d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Image limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 08:46:07.250158 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-832ef776-96af-4476-b3a2-4b715e1d036d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Flavor pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 08:46:07.250606 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-832ef776-96af-4476-b3a2-4b715e1d036d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Image pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 08:46:07.251017 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-832ef776-96af-4476-b3a2-4b715e1d036d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 08:46:07.259785 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-832ef776-96af-4476-b3a2-4b715e1d036d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:07.260262 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-832ef776-96af-4476-b3a2-4b715e1d036d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:07.260694 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-832ef776-96af-4476-b3a2-4b715e1d036d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:07.261632 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-832ef776-96af-4476-b3a2-4b715e1d036d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:07.262083 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-832ef776-96af-4476-b3a2-4b715e1d036d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:07.262504 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-832ef776-96af-4476-b3a2-4b715e1d036d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:07.278639 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-832ef776-96af-4476-b3a2-4b715e1d036d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Getting quotas for project 34b106e46b2c4fb292353a6176c9f699. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:46:07.282551 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-832ef776-96af-4476-b3a2-4b715e1d036d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Getting quotas for user 49114d25c04144269e3eb88448e2c2ee and project 34b106e46b2c4fb292353a6176c9f699. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:46:07.293747 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-832ef776-96af-4476-b3a2-4b715e1d036d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Going to run 1 instances... {{(pid=127297) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 08:46:07.296077 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-832ef776-96af-4476-b3a2-4b715e1d036d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 43b85b50-c35a-4f5e-a5cc-c67859166b3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4467450c-a35c-42e3-af85-a13291b0b2aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 08:46:07.339045 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR oslo.messaging._drivers.impl_rabbit [None req-832ef776-96af-4476-b3a2-4b715e1d036d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [d886a98b-faff-46f9-9500-7ec836957a24] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 17 08:46:08.346159 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO oslo.messaging._drivers.impl_rabbit [None req-832ef776-96af-4476-b3a2-4b715e1d036d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [d886a98b-faff-46f9-9500-7ec836957a24] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 55170. Aug 17 08:46:08.349942 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-832ef776-96af-4476-b3a2-4b715e1d036d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.570032 Aug 17 08:46:08.350606 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 387/762] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 08:46:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 1571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 08:46:08.361958 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-95741acf-bfc8-4e7e-9596-3e3b26fb5732 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:08.362563 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-95741acf-bfc8-4e7e-9596-3e3b26fb5732 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 43b85b50-c35a-4f5e-a5cc-c67859166b3c] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:08.415682 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-95741acf-bfc8-4e7e-9596-3e3b26fb5732 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:08.423061 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-95741acf-bfc8-4e7e-9596-3e3b26fb5732 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c" status: 200 len: 1241 microversion: 2.1 time: 0.065599 Aug 17 08:46:08.423706 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 376/763] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:46:08 2022] GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:46:09.444847 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-9ad488f1-95b8-463e-ba7a-6f7f5ba43714 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:09.446080 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-9ad488f1-95b8-463e-ba7a-6f7f5ba43714 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 43b85b50-c35a-4f5e-a5cc-c67859166b3c] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:09.453839 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9ad488f1-95b8-463e-ba7a-6f7f5ba43714 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:09.454328 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9ad488f1-95b8-463e-ba7a-6f7f5ba43714 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:09.454755 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9ad488f1-95b8-463e-ba7a-6f7f5ba43714 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:09.455666 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9ad488f1-95b8-463e-ba7a-6f7f5ba43714 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:09.456279 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9ad488f1-95b8-463e-ba7a-6f7f5ba43714 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:09.456869 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9ad488f1-95b8-463e-ba7a-6f7f5ba43714 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:09.525226 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-9ad488f1-95b8-463e-ba7a-6f7f5ba43714 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:09.534250 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-9ad488f1-95b8-463e-ba7a-6f7f5ba43714 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c" status: 200 len: 1299 microversion: 2.1 time: 0.093732 Aug 17 08:46:09.534822 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 388/764] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:46:09 2022] GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:46:10.554606 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-292555c5-1394-4484-9333-0eb5851b38c3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:10.555769 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-292555c5-1394-4484-9333-0eb5851b38c3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 43b85b50-c35a-4f5e-a5cc-c67859166b3c] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:10.561919 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-292555c5-1394-4484-9333-0eb5851b38c3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:10.562394 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-292555c5-1394-4484-9333-0eb5851b38c3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:10.562821 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-292555c5-1394-4484-9333-0eb5851b38c3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:10.563501 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-292555c5-1394-4484-9333-0eb5851b38c3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:10.563968 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-292555c5-1394-4484-9333-0eb5851b38c3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:10.564380 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-292555c5-1394-4484-9333-0eb5851b38c3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:10.763952 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-292555c5-1394-4484-9333-0eb5851b38c3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:10.771353 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-292555c5-1394-4484-9333-0eb5851b38c3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c" status: 200 len: 1367 microversion: 2.1 time: 0.220713 Aug 17 08:46:10.771943 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 377/765] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:46:10 2022] GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:46:10.835297 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-6c57dbc4-4879-4fc0-992a-3e11189f0207 req-10e8608a-1e1f-431f-94dd-336754bcbad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43b85b50-c35a-4f5e-a5cc-c67859166b3c", "tag": "7c6f2f32-18eb-4912-aff5-95be684b5ac7"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:46:10.845920 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-6c57dbc4-4879-4fc0-992a-3e11189f0207 req-10e8608a-1e1f-431f-94dd-336754bcbad7 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:10.846678 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-6c57dbc4-4879-4fc0-992a-3e11189f0207 req-10e8608a-1e1f-431f-94dd-336754bcbad7 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:10.847107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-6c57dbc4-4879-4fc0-992a-3e11189f0207 req-10e8608a-1e1f-431f-94dd-336754bcbad7 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:10.858188 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-6c57dbc4-4879-4fc0-992a-3e11189f0207 req-10e8608a-1e1f-431f-94dd-336754bcbad7 service nova] Creating event network-changed:7c6f2f32-18eb-4912-aff5-95be684b5ac7 for instance 43b85b50-c35a-4f5e-a5cc-c67859166b3c on hv-cinder-85331 Aug 17 08:46:10.862942 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-6c57dbc4-4879-4fc0-992a-3e11189f0207 req-10e8608a-1e1f-431f-94dd-336754bcbad7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031526 Aug 17 08:46:10.863531 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 389/766] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:46:11.793342 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-095994e3-e691-4637-8b63-43f28976ba44 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:11.793875 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-095994e3-e691-4637-8b63-43f28976ba44 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 43b85b50-c35a-4f5e-a5cc-c67859166b3c] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:11.800451 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-095994e3-e691-4637-8b63-43f28976ba44 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:11.800935 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-095994e3-e691-4637-8b63-43f28976ba44 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:11.801369 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-095994e3-e691-4637-8b63-43f28976ba44 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:11.802070 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-095994e3-e691-4637-8b63-43f28976ba44 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:11.802520 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-095994e3-e691-4637-8b63-43f28976ba44 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:11.802941 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-095994e3-e691-4637-8b63-43f28976ba44 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:11.929830 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-095994e3-e691-4637-8b63-43f28976ba44 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:11.937084 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-095994e3-e691-4637-8b63-43f28976ba44 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c" status: 200 len: 1367 microversion: 2.1 time: 0.148693 Aug 17 08:46:11.937645 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 378/767] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:46:11 2022] GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:46:12.958825 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5a9ce13f-dc29-4bf8-843c-1ac05f9f24e7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:12.959426 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-5a9ce13f-dc29-4bf8-843c-1ac05f9f24e7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 43b85b50-c35a-4f5e-a5cc-c67859166b3c] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:12.965985 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5a9ce13f-dc29-4bf8-843c-1ac05f9f24e7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:12.966460 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5a9ce13f-dc29-4bf8-843c-1ac05f9f24e7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:12.966889 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5a9ce13f-dc29-4bf8-843c-1ac05f9f24e7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:12.967588 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5a9ce13f-dc29-4bf8-843c-1ac05f9f24e7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:12.968041 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5a9ce13f-dc29-4bf8-843c-1ac05f9f24e7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:12.968458 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5a9ce13f-dc29-4bf8-843c-1ac05f9f24e7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:12.972464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:46:13.097811 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-5a9ce13f-dc29-4bf8-843c-1ac05f9f24e7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:13.105228 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-5a9ce13f-dc29-4bf8-843c-1ac05f9f24e7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c" status: 200 len: 1367 microversion: 2.1 time: 0.151115 Aug 17 08:46:13.105794 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 390/768] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:46:12 2022] GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:46:14.126510 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-aa0e613f-c5f4-4be2-9065-6283667a6ac8 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:14.127114 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-aa0e613f-c5f4-4be2-9065-6283667a6ac8 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 43b85b50-c35a-4f5e-a5cc-c67859166b3c] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:14.133573 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-aa0e613f-c5f4-4be2-9065-6283667a6ac8 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:14.134045 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-aa0e613f-c5f4-4be2-9065-6283667a6ac8 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:14.134467 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-aa0e613f-c5f4-4be2-9065-6283667a6ac8 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:14.135149 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-aa0e613f-c5f4-4be2-9065-6283667a6ac8 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:14.135610 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-aa0e613f-c5f4-4be2-9065-6283667a6ac8 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:14.136028 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-aa0e613f-c5f4-4be2-9065-6283667a6ac8 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:14.263191 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-aa0e613f-c5f4-4be2-9065-6283667a6ac8 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:14.270506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-aa0e613f-c5f4-4be2-9065-6283667a6ac8 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c" status: 200 len: 1367 microversion: 2.1 time: 0.148078 Aug 17 08:46:14.271070 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 379/769] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:46:14 2022] GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:46:15.291423 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4b4dfefe-b9fb-4d3d-b609-718ef39c8eaa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:15.292107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-4b4dfefe-b9fb-4d3d-b609-718ef39c8eaa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 43b85b50-c35a-4f5e-a5cc-c67859166b3c] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:15.298439 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4b4dfefe-b9fb-4d3d-b609-718ef39c8eaa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:15.298919 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4b4dfefe-b9fb-4d3d-b609-718ef39c8eaa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:15.299349 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4b4dfefe-b9fb-4d3d-b609-718ef39c8eaa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:15.300047 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4b4dfefe-b9fb-4d3d-b609-718ef39c8eaa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:15.300496 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4b4dfefe-b9fb-4d3d-b609-718ef39c8eaa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:15.300916 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4b4dfefe-b9fb-4d3d-b609-718ef39c8eaa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:15.433094 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-4b4dfefe-b9fb-4d3d-b609-718ef39c8eaa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:15.440521 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4b4dfefe-b9fb-4d3d-b609-718ef39c8eaa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c" status: 200 len: 1367 microversion: 2.1 time: 0.153035 Aug 17 08:46:15.441095 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 391/770] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:46:15 2022] GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:46:16.087585 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-ec1d1fd3-40b4-4269-a90e-c42dcb01dc10 req-121cf23e-1a60-4cdf-980b-68f57e651a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43b85b50-c35a-4f5e-a5cc-c67859166b3c", "name": "network-vif-plugged", "status": "completed", "tag": "7c6f2f32-18eb-4912-aff5-95be684b5ac7"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:46:16.097502 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-ec1d1fd3-40b4-4269-a90e-c42dcb01dc10 req-121cf23e-1a60-4cdf-980b-68f57e651a49 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:16.098015 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-ec1d1fd3-40b4-4269-a90e-c42dcb01dc10 req-121cf23e-1a60-4cdf-980b-68f57e651a49 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:16.098424 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-ec1d1fd3-40b4-4269-a90e-c42dcb01dc10 req-121cf23e-1a60-4cdf-980b-68f57e651a49 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:16.110035 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-ec1d1fd3-40b4-4269-a90e-c42dcb01dc10 req-121cf23e-1a60-4cdf-980b-68f57e651a49 service nova] Creating event network-vif-plugged:7c6f2f32-18eb-4912-aff5-95be684b5ac7 for instance 43b85b50-c35a-4f5e-a5cc-c67859166b3c on hv-cinder-85331 Aug 17 08:46:16.114778 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-ec1d1fd3-40b4-4269-a90e-c42dcb01dc10 req-121cf23e-1a60-4cdf-980b-68f57e651a49 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031104 Aug 17 08:46:16.115359 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 380/771] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:46:16.460574 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ee016c83-9600-4d05-91af-c32109759c7f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:16.461175 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ee016c83-9600-4d05-91af-c32109759c7f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 43b85b50-c35a-4f5e-a5cc-c67859166b3c] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:16.467965 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ee016c83-9600-4d05-91af-c32109759c7f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:16.468436 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ee016c83-9600-4d05-91af-c32109759c7f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:16.468889 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ee016c83-9600-4d05-91af-c32109759c7f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:16.469567 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ee016c83-9600-4d05-91af-c32109759c7f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:16.470016 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ee016c83-9600-4d05-91af-c32109759c7f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:16.470427 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ee016c83-9600-4d05-91af-c32109759c7f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:16.597363 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ee016c83-9600-4d05-91af-c32109759c7f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:16.605264 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ee016c83-9600-4d05-91af-c32109759c7f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c" status: 200 len: 1367 microversion: 2.1 time: 0.148091 Aug 17 08:46:16.605835 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 392/772] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:46:16 2022] GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:46:17.627303 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-24f3a27c-d1b2-4e7b-a39f-f8bc0de130e6 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:17.628014 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-24f3a27c-d1b2-4e7b-a39f-f8bc0de130e6 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 43b85b50-c35a-4f5e-a5cc-c67859166b3c] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:17.634132 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-24f3a27c-d1b2-4e7b-a39f-f8bc0de130e6 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:17.634609 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-24f3a27c-d1b2-4e7b-a39f-f8bc0de130e6 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:17.635039 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-24f3a27c-d1b2-4e7b-a39f-f8bc0de130e6 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:17.635748 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-24f3a27c-d1b2-4e7b-a39f-f8bc0de130e6 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:17.636195 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-24f3a27c-d1b2-4e7b-a39f-f8bc0de130e6 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:17.636642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-24f3a27c-d1b2-4e7b-a39f-f8bc0de130e6 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:17.762411 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-24f3a27c-d1b2-4e7b-a39f-f8bc0de130e6 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:17.769718 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-24f3a27c-d1b2-4e7b-a39f-f8bc0de130e6 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c" status: 200 len: 1557 microversion: 2.1 time: 0.147206 Aug 17 08:46:17.770305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 381/773] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:46:17 2022] GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:46:17.789603 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b2c4d7f7-a31c-4857-84c7-ea5d5068e6ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:17.790081 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b2c4d7f7-a31c-4857-84c7-ea5d5068e6ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 43b85b50-c35a-4f5e-a5cc-c67859166b3c] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:17.792411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:46:17.793059 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=6 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:46:17.799513 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b2c4d7f7-a31c-4857-84c7-ea5d5068e6ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:17.800010 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b2c4d7f7-a31c-4857-84c7-ea5d5068e6ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:17.800433 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b2c4d7f7-a31c-4857-84c7-ea5d5068e6ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:17.801101 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b2c4d7f7-a31c-4857-84c7-ea5d5068e6ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:17.801540 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b2c4d7f7-a31c-4857-84c7-ea5d5068e6ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:17.801950 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b2c4d7f7-a31c-4857-84c7-ea5d5068e6ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:17.882366 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b2c4d7f7-a31c-4857-84c7-ea5d5068e6ba tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096490 Aug 17 08:46:17.882978 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 393/774] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 17 08:46:17 2022] GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:46:18.780544 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-a82c1dd0-1cfe-46ab-aa71-453ef8ec380e req-5178143a-a42c-45ee-91aa-77f6279dde4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43b85b50-c35a-4f5e-a5cc-c67859166b3c", "tag": "7c6f2f32-18eb-4912-aff5-95be684b5ac7"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:46:18.785235 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=6 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:46:18.791779 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-a82c1dd0-1cfe-46ab-aa71-453ef8ec380e req-5178143a-a42c-45ee-91aa-77f6279dde4f service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:18.792287 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-a82c1dd0-1cfe-46ab-aa71-453ef8ec380e req-5178143a-a42c-45ee-91aa-77f6279dde4f service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:18.792711 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-a82c1dd0-1cfe-46ab-aa71-453ef8ec380e req-5178143a-a42c-45ee-91aa-77f6279dde4f service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:18.805512 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-a82c1dd0-1cfe-46ab-aa71-453ef8ec380e req-5178143a-a42c-45ee-91aa-77f6279dde4f service nova] Creating event network-changed:7c6f2f32-18eb-4912-aff5-95be684b5ac7 for instance 43b85b50-c35a-4f5e-a5cc-c67859166b3c on hv-cinder-85331 Aug 17 08:46:18.811023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-a82c1dd0-1cfe-46ab-aa71-453ef8ec380e req-5178143a-a42c-45ee-91aa-77f6279dde4f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034029 Aug 17 08:46:18.811836 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 382/775] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:46:37.594927 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:46:37.595832 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=20 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:46:37.599980 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-fe4cf824-52f1-4823-983c-741bbd656514 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:37.600458 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fe4cf824-52f1-4823-983c-741bbd656514 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:37.608632 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fe4cf824-52f1-4823-983c-741bbd656514 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:37.609108 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fe4cf824-52f1-4823-983c-741bbd656514 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:37.609753 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fe4cf824-52f1-4823-983c-741bbd656514 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:37.610199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fe4cf824-52f1-4823-983c-741bbd656514 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:37.610640 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fe4cf824-52f1-4823-983c-741bbd656514 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:37.611055 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fe4cf824-52f1-4823-983c-741bbd656514 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:37.637018 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-fe4cf824-52f1-4823-983c-741bbd656514 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b/ips" status: 200 len: 153 microversion: 2.20 time: 0.043437 Aug 17 08:46:37.637573 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 394/776] 10.222.0.15 () {60 vars in 1289 bytes} [Wed Aug 17 08:46:37 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b/ips => generated 153 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 08:46:39.710480 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:46:39.711255 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:46:39.717142 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0f5b3d3d-db00-4949-b95a-52bf28f7ef28 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:46:39.717763 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0f5b3d3d-db00-4949-b95a-52bf28f7ef28 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:39.726594 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0f5b3d3d-db00-4949-b95a-52bf28f7ef28 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:39.727068 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0f5b3d3d-db00-4949-b95a-52bf28f7ef28 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:39.727513 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0f5b3d3d-db00-4949-b95a-52bf28f7ef28 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:39.728780 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0f5b3d3d-db00-4949-b95a-52bf28f7ef28 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:39.729217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0f5b3d3d-db00-4949-b95a-52bf28f7ef28 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:39.729633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0f5b3d3d-db00-4949-b95a-52bf28f7ef28 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:39.752396 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-0f5b3d3d-db00-4949-b95a-52bf28f7ef28 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lazy-loading 'flavor' on Instance uuid f579cfbe-0b43-4710-8ba4-ba221a36e20b {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:46:39.941177 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0f5b3d3d-db00-4949-b95a-52bf28f7ef28 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "POST /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b/action" status: 202 len: 0 microversion: 2.20 time: 0.231912 Aug 17 08:46:39.941771 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 383/777] 10.222.0.15 () {62 vars in 1319 bytes} [Wed Aug 17 08:46:39 2022] POST /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 08:46:39.950928 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-81edd7e7-656f-4452-aba3-c77f2ef9849a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:39.952234 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-81edd7e7-656f-4452-aba3-c77f2ef9849a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:39.960221 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-81edd7e7-656f-4452-aba3-c77f2ef9849a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:39.961203 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-81edd7e7-656f-4452-aba3-c77f2ef9849a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:39.965343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-81edd7e7-656f-4452-aba3-c77f2ef9849a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:39.965343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-81edd7e7-656f-4452-aba3-c77f2ef9849a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:39.965343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-81edd7e7-656f-4452-aba3-c77f2ef9849a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:39.965343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-81edd7e7-656f-4452-aba3-c77f2ef9849a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:40.105908 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-81edd7e7-656f-4452-aba3-c77f2ef9849a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:40.114015 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-81edd7e7-656f-4452-aba3-c77f2ef9849a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:40.115514 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-81edd7e7-656f-4452-aba3-c77f2ef9849a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:40.116940 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-81edd7e7-656f-4452-aba3-c77f2ef9849a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1725 microversion: 2.20 time: 0.170554 Aug 17 08:46:40.117503 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 395/778] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:46:39 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:46:41.143156 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0a72878c-9e68-484d-abd4-e01df213a090 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:41.143860 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0a72878c-9e68-484d-abd4-e01df213a090 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:41.150625 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0a72878c-9e68-484d-abd4-e01df213a090 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:41.151095 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0a72878c-9e68-484d-abd4-e01df213a090 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:41.151513 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0a72878c-9e68-484d-abd4-e01df213a090 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:41.152201 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0a72878c-9e68-484d-abd4-e01df213a090 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:41.152638 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0a72878c-9e68-484d-abd4-e01df213a090 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:41.153046 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0a72878c-9e68-484d-abd4-e01df213a090 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:41.285750 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0a72878c-9e68-484d-abd4-e01df213a090 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:41.293557 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0a72878c-9e68-484d-abd4-e01df213a090 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:41.295041 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0a72878c-9e68-484d-abd4-e01df213a090 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:41.296237 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0a72878c-9e68-484d-abd4-e01df213a090 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1725 microversion: 2.20 time: 0.157767 Aug 17 08:46:41.296778 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 384/779] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:46:41 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:46:42.319100 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3aa56718-0024-4908-8424-40daafa5c2f1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:42.319725 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3aa56718-0024-4908-8424-40daafa5c2f1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:42.326744 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3aa56718-0024-4908-8424-40daafa5c2f1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:42.327220 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3aa56718-0024-4908-8424-40daafa5c2f1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:42.327673 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3aa56718-0024-4908-8424-40daafa5c2f1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:42.328348 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3aa56718-0024-4908-8424-40daafa5c2f1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:42.328792 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3aa56718-0024-4908-8424-40daafa5c2f1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:42.329206 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3aa56718-0024-4908-8424-40daafa5c2f1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:42.453781 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3aa56718-0024-4908-8424-40daafa5c2f1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:42.461619 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3aa56718-0024-4908-8424-40daafa5c2f1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:42.463759 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3aa56718-0024-4908-8424-40daafa5c2f1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:42.464892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3aa56718-0024-4908-8424-40daafa5c2f1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1725 microversion: 2.20 time: 0.149665 Aug 17 08:46:42.465446 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 396/780] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:46:42 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:46:43.487296 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2538ace5-85ae-4d39-b691-ada7136f9349 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:43.487936 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2538ace5-85ae-4d39-b691-ada7136f9349 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:43.494336 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2538ace5-85ae-4d39-b691-ada7136f9349 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:43.494812 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2538ace5-85ae-4d39-b691-ada7136f9349 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:43.495239 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2538ace5-85ae-4d39-b691-ada7136f9349 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:43.496056 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2538ace5-85ae-4d39-b691-ada7136f9349 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:43.496502 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2538ace5-85ae-4d39-b691-ada7136f9349 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:43.496918 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2538ace5-85ae-4d39-b691-ada7136f9349 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:43.624632 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2538ace5-85ae-4d39-b691-ada7136f9349 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:43.632649 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2538ace5-85ae-4d39-b691-ada7136f9349 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:43.634149 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2538ace5-85ae-4d39-b691-ada7136f9349 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:43.635284 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2538ace5-85ae-4d39-b691-ada7136f9349 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1725 microversion: 2.20 time: 0.151898 Aug 17 08:46:43.635867 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 385/781] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:46:43 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:46:44.658315 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f2641d62-753a-4192-a332-56ec733caed0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:44.658908 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f2641d62-753a-4192-a332-56ec733caed0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:44.665355 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f2641d62-753a-4192-a332-56ec733caed0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:44.665828 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f2641d62-753a-4192-a332-56ec733caed0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:44.666252 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f2641d62-753a-4192-a332-56ec733caed0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:44.666918 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f2641d62-753a-4192-a332-56ec733caed0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:44.667358 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f2641d62-753a-4192-a332-56ec733caed0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:44.667796 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f2641d62-753a-4192-a332-56ec733caed0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:44.793088 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-f2641d62-753a-4192-a332-56ec733caed0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:44.800848 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-f2641d62-753a-4192-a332-56ec733caed0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:44.802382 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-f2641d62-753a-4192-a332-56ec733caed0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:44.803449 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f2641d62-753a-4192-a332-56ec733caed0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1725 microversion: 2.20 time: 0.149081 Aug 17 08:46:44.804028 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 397/782] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:46:44 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:46:45.826597 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-48a43a18-e1f8-42fb-a7ba-1f5e9c839013 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:45.827149 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-48a43a18-e1f8-42fb-a7ba-1f5e9c839013 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:45.833590 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-48a43a18-e1f8-42fb-a7ba-1f5e9c839013 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:45.834063 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-48a43a18-e1f8-42fb-a7ba-1f5e9c839013 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:45.834489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-48a43a18-e1f8-42fb-a7ba-1f5e9c839013 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:45.835160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-48a43a18-e1f8-42fb-a7ba-1f5e9c839013 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:45.835633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-48a43a18-e1f8-42fb-a7ba-1f5e9c839013 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:45.836050 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-48a43a18-e1f8-42fb-a7ba-1f5e9c839013 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:45.960667 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-48a43a18-e1f8-42fb-a7ba-1f5e9c839013 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:45.968666 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-48a43a18-e1f8-42fb-a7ba-1f5e9c839013 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:45.970168 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-48a43a18-e1f8-42fb-a7ba-1f5e9c839013 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:45.971304 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-48a43a18-e1f8-42fb-a7ba-1f5e9c839013 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1725 microversion: 2.20 time: 0.148935 Aug 17 08:46:45.971891 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 386/783] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:46:45 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:46:46.994804 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-60f1284d-28be-46a1-8d06-95351480ce90 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:46.995402 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-60f1284d-28be-46a1-8d06-95351480ce90 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:47.001759 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-60f1284d-28be-46a1-8d06-95351480ce90 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:47.002228 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-60f1284d-28be-46a1-8d06-95351480ce90 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:47.002650 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-60f1284d-28be-46a1-8d06-95351480ce90 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:47.003315 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-60f1284d-28be-46a1-8d06-95351480ce90 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:47.003821 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-60f1284d-28be-46a1-8d06-95351480ce90 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:47.004232 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-60f1284d-28be-46a1-8d06-95351480ce90 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:47.132209 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-60f1284d-28be-46a1-8d06-95351480ce90 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:47.139977 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-60f1284d-28be-46a1-8d06-95351480ce90 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:47.141489 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-60f1284d-28be-46a1-8d06-95351480ce90 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:47.142639 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-60f1284d-28be-46a1-8d06-95351480ce90 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1725 microversion: 2.20 time: 0.152324 Aug 17 08:46:47.143196 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 398/784] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:46:46 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:46:48.167615 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f7bd1d59-981d-4877-8873-882a7a801c50 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:48.168123 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f7bd1d59-981d-4877-8873-882a7a801c50 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:48.174434 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f7bd1d59-981d-4877-8873-882a7a801c50 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:48.174936 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f7bd1d59-981d-4877-8873-882a7a801c50 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:48.175361 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f7bd1d59-981d-4877-8873-882a7a801c50 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:48.176067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f7bd1d59-981d-4877-8873-882a7a801c50 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:48.176524 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f7bd1d59-981d-4877-8873-882a7a801c50 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:48.176936 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f7bd1d59-981d-4877-8873-882a7a801c50 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:48.316262 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f7bd1d59-981d-4877-8873-882a7a801c50 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:48.326019 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f7bd1d59-981d-4877-8873-882a7a801c50 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:48.327803 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f7bd1d59-981d-4877-8873-882a7a801c50 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:48.329397 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f7bd1d59-981d-4877-8873-882a7a801c50 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1725 microversion: 2.20 time: 0.165637 Aug 17 08:46:48.330569 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 387/785] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:46:48 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:46:49.352477 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-63d002d4-0132-4779-9ea9-24da10227b88 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:49.352992 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-63d002d4-0132-4779-9ea9-24da10227b88 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:49.359415 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-63d002d4-0132-4779-9ea9-24da10227b88 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:49.359921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-63d002d4-0132-4779-9ea9-24da10227b88 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:49.360351 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-63d002d4-0132-4779-9ea9-24da10227b88 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:49.361059 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-63d002d4-0132-4779-9ea9-24da10227b88 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:49.361505 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-63d002d4-0132-4779-9ea9-24da10227b88 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:49.361921 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-63d002d4-0132-4779-9ea9-24da10227b88 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:49.486082 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-63d002d4-0132-4779-9ea9-24da10227b88 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:49.494339 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-63d002d4-0132-4779-9ea9-24da10227b88 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:49.495856 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-63d002d4-0132-4779-9ea9-24da10227b88 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:49.496998 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-63d002d4-0132-4779-9ea9-24da10227b88 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1725 microversion: 2.20 time: 0.148544 Aug 17 08:46:49.497558 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 399/786] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:46:49 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:46:50.519355 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2d910e0d-7da0-483d-9676-531da69c4942 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:50.520040 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2d910e0d-7da0-483d-9676-531da69c4942 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:50.526955 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2d910e0d-7da0-483d-9676-531da69c4942 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:50.527439 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2d910e0d-7da0-483d-9676-531da69c4942 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:50.527891 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2d910e0d-7da0-483d-9676-531da69c4942 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:50.528594 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2d910e0d-7da0-483d-9676-531da69c4942 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:50.529041 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2d910e0d-7da0-483d-9676-531da69c4942 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:50.529459 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-2d910e0d-7da0-483d-9676-531da69c4942 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:50.658443 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2d910e0d-7da0-483d-9676-531da69c4942 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:50.666257 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2d910e0d-7da0-483d-9676-531da69c4942 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:50.667781 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2d910e0d-7da0-483d-9676-531da69c4942 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:50.668913 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2d910e0d-7da0-483d-9676-531da69c4942 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1725 microversion: 2.20 time: 0.153483 Aug 17 08:46:50.669474 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 388/787] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:46:50 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:46:51.691506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-06d91c2b-18b0-4ef1-9b92-0599dcbaeca8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:51.692152 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-06d91c2b-18b0-4ef1-9b92-0599dcbaeca8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:51.698568 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-06d91c2b-18b0-4ef1-9b92-0599dcbaeca8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:51.699043 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-06d91c2b-18b0-4ef1-9b92-0599dcbaeca8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:51.699469 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-06d91c2b-18b0-4ef1-9b92-0599dcbaeca8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:51.700439 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-06d91c2b-18b0-4ef1-9b92-0599dcbaeca8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:51.700884 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-06d91c2b-18b0-4ef1-9b92-0599dcbaeca8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:51.701298 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-06d91c2b-18b0-4ef1-9b92-0599dcbaeca8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:51.831497 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-06d91c2b-18b0-4ef1-9b92-0599dcbaeca8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:51.839899 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-06d91c2b-18b0-4ef1-9b92-0599dcbaeca8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:51.841385 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-06d91c2b-18b0-4ef1-9b92-0599dcbaeca8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:51.842518 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-06d91c2b-18b0-4ef1-9b92-0599dcbaeca8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1725 microversion: 2.20 time: 0.154893 Aug 17 08:46:51.843080 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 400/788] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:46:51 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:46:52.865990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ab43c7ef-6eb1-4dc9-bc83-147ee27cc810 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:52.866521 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ab43c7ef-6eb1-4dc9-bc83-147ee27cc810 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:52.873931 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ab43c7ef-6eb1-4dc9-bc83-147ee27cc810 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:52.874408 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ab43c7ef-6eb1-4dc9-bc83-147ee27cc810 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:52.874837 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ab43c7ef-6eb1-4dc9-bc83-147ee27cc810 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:52.875513 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ab43c7ef-6eb1-4dc9-bc83-147ee27cc810 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:52.876039 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ab43c7ef-6eb1-4dc9-bc83-147ee27cc810 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:52.876459 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ab43c7ef-6eb1-4dc9-bc83-147ee27cc810 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:53.004895 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ab43c7ef-6eb1-4dc9-bc83-147ee27cc810 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:53.013411 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ab43c7ef-6eb1-4dc9-bc83-147ee27cc810 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:53.014911 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ab43c7ef-6eb1-4dc9-bc83-147ee27cc810 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:53.016093 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ab43c7ef-6eb1-4dc9-bc83-147ee27cc810 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1725 microversion: 2.20 time: 0.154123 Aug 17 08:46:53.016650 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 389/789] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:46:52 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:46:54.038507 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-bd56466f-2d82-475e-95a3-7cf267841dea tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:54.039107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-bd56466f-2d82-475e-95a3-7cf267841dea tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:54.045519 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bd56466f-2d82-475e-95a3-7cf267841dea tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:54.046001 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bd56466f-2d82-475e-95a3-7cf267841dea tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:54.046771 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bd56466f-2d82-475e-95a3-7cf267841dea tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:54.047457 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bd56466f-2d82-475e-95a3-7cf267841dea tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:54.047937 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bd56466f-2d82-475e-95a3-7cf267841dea tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:54.048364 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bd56466f-2d82-475e-95a3-7cf267841dea tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:54.173892 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-bd56466f-2d82-475e-95a3-7cf267841dea tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:54.182195 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-bd56466f-2d82-475e-95a3-7cf267841dea tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:54.183703 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-bd56466f-2d82-475e-95a3-7cf267841dea tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:54.184835 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-bd56466f-2d82-475e-95a3-7cf267841dea tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1725 microversion: 2.20 time: 0.150331 Aug 17 08:46:54.185385 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 401/790] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:46:54 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:46:55.208234 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5fc470e3-5b29-4978-b1e4-11edd0e397aa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:55.208836 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5fc470e3-5b29-4978-b1e4-11edd0e397aa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:55.215218 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5fc470e3-5b29-4978-b1e4-11edd0e397aa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:55.215734 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5fc470e3-5b29-4978-b1e4-11edd0e397aa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:55.216160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5fc470e3-5b29-4978-b1e4-11edd0e397aa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:55.216837 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5fc470e3-5b29-4978-b1e4-11edd0e397aa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:55.217282 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5fc470e3-5b29-4978-b1e4-11edd0e397aa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:55.217697 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5fc470e3-5b29-4978-b1e4-11edd0e397aa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:55.342356 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5fc470e3-5b29-4978-b1e4-11edd0e397aa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:55.350094 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5fc470e3-5b29-4978-b1e4-11edd0e397aa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:55.351609 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5fc470e3-5b29-4978-b1e4-11edd0e397aa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:55.353310 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5fc470e3-5b29-4978-b1e4-11edd0e397aa tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1725 microversion: 2.20 time: 0.148874 Aug 17 08:46:55.353871 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 390/791] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:46:55 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:46:56.377164 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3b87d1c1-63b1-4949-bdf9-07ef3d81380a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:56.377751 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3b87d1c1-63b1-4949-bdf9-07ef3d81380a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:56.384111 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3b87d1c1-63b1-4949-bdf9-07ef3d81380a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:56.384583 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3b87d1c1-63b1-4949-bdf9-07ef3d81380a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:56.385010 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3b87d1c1-63b1-4949-bdf9-07ef3d81380a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:56.385679 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3b87d1c1-63b1-4949-bdf9-07ef3d81380a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:56.386121 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3b87d1c1-63b1-4949-bdf9-07ef3d81380a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:56.386534 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3b87d1c1-63b1-4949-bdf9-07ef3d81380a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:56.511503 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3b87d1c1-63b1-4949-bdf9-07ef3d81380a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:56.519427 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3b87d1c1-63b1-4949-bdf9-07ef3d81380a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:56.520969 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3b87d1c1-63b1-4949-bdf9-07ef3d81380a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:56.522087 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3b87d1c1-63b1-4949-bdf9-07ef3d81380a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1746 microversion: 2.20 time: 0.148839 Aug 17 08:46:56.522644 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 402/792] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:46:56 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:46:57.546610 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8c252a94-d7e2-4683-a8d9-217b4c68fa4a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:57.547327 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8c252a94-d7e2-4683-a8d9-217b4c68fa4a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:57.553766 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8c252a94-d7e2-4683-a8d9-217b4c68fa4a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:57.554247 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8c252a94-d7e2-4683-a8d9-217b4c68fa4a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:57.554673 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8c252a94-d7e2-4683-a8d9-217b4c68fa4a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:57.556015 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8c252a94-d7e2-4683-a8d9-217b4c68fa4a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:57.556540 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8c252a94-d7e2-4683-a8d9-217b4c68fa4a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:57.556955 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8c252a94-d7e2-4683-a8d9-217b4c68fa4a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:57.686467 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8c252a94-d7e2-4683-a8d9-217b4c68fa4a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:57.694351 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8c252a94-d7e2-4683-a8d9-217b4c68fa4a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:57.695882 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8c252a94-d7e2-4683-a8d9-217b4c68fa4a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:57.697017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8c252a94-d7e2-4683-a8d9-217b4c68fa4a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1746 microversion: 2.20 time: 0.154326 Aug 17 08:46:57.697580 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 391/793] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:46:57 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:46:58.720742 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-fdd58ec9-401c-4f02-8a8c-9d6f650d6672 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:58.721508 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fdd58ec9-401c-4f02-8a8c-9d6f650d6672 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:58.729923 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fdd58ec9-401c-4f02-8a8c-9d6f650d6672 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:58.732329 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fdd58ec9-401c-4f02-8a8c-9d6f650d6672 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:58.732874 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fdd58ec9-401c-4f02-8a8c-9d6f650d6672 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:58.735032 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fdd58ec9-401c-4f02-8a8c-9d6f650d6672 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:58.735584 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fdd58ec9-401c-4f02-8a8c-9d6f650d6672 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:58.737537 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fdd58ec9-401c-4f02-8a8c-9d6f650d6672 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:58.909280 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-fdd58ec9-401c-4f02-8a8c-9d6f650d6672 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:58.925613 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-fdd58ec9-401c-4f02-8a8c-9d6f650d6672 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:58.927572 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-fdd58ec9-401c-4f02-8a8c-9d6f650d6672 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:46:58.928983 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-fdd58ec9-401c-4f02-8a8c-9d6f650d6672 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1741 microversion: 2.20 time: 0.212137 Aug 17 08:46:58.930137 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 403/794] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:46:58 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1741 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:46:59.953003 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-50016328-ad8f-4936-9325-3e2a269b0750 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:46:59.954239 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-50016328-ad8f-4936-9325-3e2a269b0750 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:46:59.961027 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-50016328-ad8f-4936-9325-3e2a269b0750 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:59.962214 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-50016328-ad8f-4936-9325-3e2a269b0750 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:59.962913 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-50016328-ad8f-4936-9325-3e2a269b0750 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:46:59.963752 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-50016328-ad8f-4936-9325-3e2a269b0750 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:46:59.964922 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-50016328-ad8f-4936-9325-3e2a269b0750 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:46:59.965422 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-50016328-ad8f-4936-9325-3e2a269b0750 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:00.129634 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-50016328-ad8f-4936-9325-3e2a269b0750 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:00.137743 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-50016328-ad8f-4936-9325-3e2a269b0750 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:00.139696 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-50016328-ad8f-4936-9325-3e2a269b0750 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:00.141043 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-50016328-ad8f-4936-9325-3e2a269b0750 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1741 microversion: 2.20 time: 0.192198 Aug 17 08:47:00.142179 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 392/795] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:46:59 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1741 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:47:00.382918 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-1de2691c-18b1-423f-9dfa-a8b25278be24 req-3ae42ed7-5d07-4530-970c-b87eee25c8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f579cfbe-0b43-4710-8ba4-ba221a36e20b", "name": "network-vif-plugged", "status": "completed", "tag": "fa872a89-5241-4d0c-9875-c10826245c65"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:47:00.397560 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-1de2691c-18b1-423f-9dfa-a8b25278be24 req-3ae42ed7-5d07-4530-970c-b87eee25c8d9 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:00.397937 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-1de2691c-18b1-423f-9dfa-a8b25278be24 req-3ae42ed7-5d07-4530-970c-b87eee25c8d9 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:00.399418 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-1de2691c-18b1-423f-9dfa-a8b25278be24 req-3ae42ed7-5d07-4530-970c-b87eee25c8d9 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:00.412791 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-1de2691c-18b1-423f-9dfa-a8b25278be24 req-3ae42ed7-5d07-4530-970c-b87eee25c8d9 service nova] Creating event network-vif-plugged:fa872a89-5241-4d0c-9875-c10826245c65 for instance f579cfbe-0b43-4710-8ba4-ba221a36e20b on hv-cinder-85331 Aug 17 08:47:00.419237 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-1de2691c-18b1-423f-9dfa-a8b25278be24 req-3ae42ed7-5d07-4530-970c-b87eee25c8d9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038861 Aug 17 08:47:00.420831 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 404/796] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:47:01.165128 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-dfa068a5-bc60-409b-8256-9d3e2cabbb28 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:01.166809 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-dfa068a5-bc60-409b-8256-9d3e2cabbb28 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:01.173680 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dfa068a5-bc60-409b-8256-9d3e2cabbb28 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:01.174251 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dfa068a5-bc60-409b-8256-9d3e2cabbb28 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:01.174930 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dfa068a5-bc60-409b-8256-9d3e2cabbb28 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:01.175735 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dfa068a5-bc60-409b-8256-9d3e2cabbb28 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:01.176298 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dfa068a5-bc60-409b-8256-9d3e2cabbb28 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:01.176802 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-dfa068a5-bc60-409b-8256-9d3e2cabbb28 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:01.318715 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-dfa068a5-bc60-409b-8256-9d3e2cabbb28 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:01.327189 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-dfa068a5-bc60-409b-8256-9d3e2cabbb28 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:01.328693 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-dfa068a5-bc60-409b-8256-9d3e2cabbb28 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:01.332160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-dfa068a5-bc60-409b-8256-9d3e2cabbb28 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1741 microversion: 2.20 time: 0.171497 Aug 17 08:47:01.347583 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 393/797] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:47:01 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1741 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:47:02.356244 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d9b0bc27-d6a2-42fa-a08c-121d205a0119 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:02.357007 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d9b0bc27-d6a2-42fa-a08c-121d205a0119 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:02.365222 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d9b0bc27-d6a2-42fa-a08c-121d205a0119 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:02.365785 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d9b0bc27-d6a2-42fa-a08c-121d205a0119 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:02.366413 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d9b0bc27-d6a2-42fa-a08c-121d205a0119 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:02.367846 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d9b0bc27-d6a2-42fa-a08c-121d205a0119 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:02.368542 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d9b0bc27-d6a2-42fa-a08c-121d205a0119 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:02.369055 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d9b0bc27-d6a2-42fa-a08c-121d205a0119 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:02.517059 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d9b0bc27-d6a2-42fa-a08c-121d205a0119 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:02.526187 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d9b0bc27-d6a2-42fa-a08c-121d205a0119 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:02.527962 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d9b0bc27-d6a2-42fa-a08c-121d205a0119 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:02.529302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d9b0bc27-d6a2-42fa-a08c-121d205a0119 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1741 microversion: 2.20 time: 0.177786 Aug 17 08:47:02.530383 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 405/798] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:47:02 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:47:03.553321 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b01c28fd-7ae0-4db8-8839-a8de60ab96d7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:03.553920 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b01c28fd-7ae0-4db8-8839-a8de60ab96d7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:03.561779 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b01c28fd-7ae0-4db8-8839-a8de60ab96d7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:03.562331 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b01c28fd-7ae0-4db8-8839-a8de60ab96d7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:03.562830 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b01c28fd-7ae0-4db8-8839-a8de60ab96d7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:03.563607 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b01c28fd-7ae0-4db8-8839-a8de60ab96d7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:03.564268 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b01c28fd-7ae0-4db8-8839-a8de60ab96d7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:03.564885 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b01c28fd-7ae0-4db8-8839-a8de60ab96d7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:03.718301 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b01c28fd-7ae0-4db8-8839-a8de60ab96d7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:03.729920 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b01c28fd-7ae0-4db8-8839-a8de60ab96d7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:03.731588 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b01c28fd-7ae0-4db8-8839-a8de60ab96d7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:03.733184 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b01c28fd-7ae0-4db8-8839-a8de60ab96d7 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1741 microversion: 2.20 time: 0.183733 Aug 17 08:47:03.733846 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 394/799] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:47:03 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1741 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:47:04.758342 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c068fcd1-3485-44c9-a429-c3e93e1dac0d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:04.758979 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c068fcd1-3485-44c9-a429-c3e93e1dac0d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:04.765826 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c068fcd1-3485-44c9-a429-c3e93e1dac0d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:04.766303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c068fcd1-3485-44c9-a429-c3e93e1dac0d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:04.766725 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c068fcd1-3485-44c9-a429-c3e93e1dac0d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:04.769649 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c068fcd1-3485-44c9-a429-c3e93e1dac0d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:04.769649 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c068fcd1-3485-44c9-a429-c3e93e1dac0d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:04.769649 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c068fcd1-3485-44c9-a429-c3e93e1dac0d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:04.925826 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c068fcd1-3485-44c9-a429-c3e93e1dac0d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:04.934429 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c068fcd1-3485-44c9-a429-c3e93e1dac0d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:04.937227 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c068fcd1-3485-44c9-a429-c3e93e1dac0d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:04.938409 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c068fcd1-3485-44c9-a429-c3e93e1dac0d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1741 microversion: 2.20 time: 0.184319 Aug 17 08:47:04.951567 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 406/800] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:47:04 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:47:05.963125 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-cbff6c1f-0360-4f65-9a05-074e513adf20 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:05.963900 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-cbff6c1f-0360-4f65-9a05-074e513adf20 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:05.970401 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cbff6c1f-0360-4f65-9a05-074e513adf20 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:05.970875 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cbff6c1f-0360-4f65-9a05-074e513adf20 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:05.971303 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cbff6c1f-0360-4f65-9a05-074e513adf20 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:05.972067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cbff6c1f-0360-4f65-9a05-074e513adf20 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:05.972522 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cbff6c1f-0360-4f65-9a05-074e513adf20 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:05.973092 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cbff6c1f-0360-4f65-9a05-074e513adf20 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:06.121765 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-cbff6c1f-0360-4f65-9a05-074e513adf20 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:06.130423 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-cbff6c1f-0360-4f65-9a05-074e513adf20 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:06.132376 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-cbff6c1f-0360-4f65-9a05-074e513adf20 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:06.134387 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-cbff6c1f-0360-4f65-9a05-074e513adf20 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1741 microversion: 2.20 time: 0.175567 Aug 17 08:47:06.135319 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 395/801] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:47:05 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1741 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:47:07.160059 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e49243b1-5ddc-48a3-ad01-82a1eda28b80 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:07.160662 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e49243b1-5ddc-48a3-ad01-82a1eda28b80 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:07.167584 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e49243b1-5ddc-48a3-ad01-82a1eda28b80 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:07.168067 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e49243b1-5ddc-48a3-ad01-82a1eda28b80 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:07.168524 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e49243b1-5ddc-48a3-ad01-82a1eda28b80 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:07.169205 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e49243b1-5ddc-48a3-ad01-82a1eda28b80 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:07.169666 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e49243b1-5ddc-48a3-ad01-82a1eda28b80 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:07.170087 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e49243b1-5ddc-48a3-ad01-82a1eda28b80 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:07.301342 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e49243b1-5ddc-48a3-ad01-82a1eda28b80 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:07.309925 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e49243b1-5ddc-48a3-ad01-82a1eda28b80 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:07.311441 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e49243b1-5ddc-48a3-ad01-82a1eda28b80 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:07.312621 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e49243b1-5ddc-48a3-ad01-82a1eda28b80 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1723 microversion: 2.20 time: 0.156595 Aug 17 08:47:07.313187 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 407/802] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:47:07 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:47:08.335533 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-22d261da-dad0-4329-9779-57be987545ad tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:08.336146 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-22d261da-dad0-4329-9779-57be987545ad tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:08.342435 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-22d261da-dad0-4329-9779-57be987545ad tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:08.342899 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-22d261da-dad0-4329-9779-57be987545ad tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:08.343317 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-22d261da-dad0-4329-9779-57be987545ad tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:08.344011 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-22d261da-dad0-4329-9779-57be987545ad tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:08.344451 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-22d261da-dad0-4329-9779-57be987545ad tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:08.344861 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-22d261da-dad0-4329-9779-57be987545ad tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:08.478700 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-22d261da-dad0-4329-9779-57be987545ad tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:08.486456 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-22d261da-dad0-4329-9779-57be987545ad tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:08.487964 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-22d261da-dad0-4329-9779-57be987545ad tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:08.489091 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-22d261da-dad0-4329-9779-57be987545ad tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1723 microversion: 2.20 time: 0.157409 Aug 17 08:47:08.489643 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 396/803] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:47:08 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:47:09.512568 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d648c9b6-94d7-4976-8ea8-1221d52019c6 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:09.513171 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d648c9b6-94d7-4976-8ea8-1221d52019c6 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:09.515604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=29 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:47:09.520681 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d648c9b6-94d7-4976-8ea8-1221d52019c6 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:09.521154 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d648c9b6-94d7-4976-8ea8-1221d52019c6 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:09.521582 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d648c9b6-94d7-4976-8ea8-1221d52019c6 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:09.522258 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d648c9b6-94d7-4976-8ea8-1221d52019c6 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:09.522701 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d648c9b6-94d7-4976-8ea8-1221d52019c6 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:09.523118 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d648c9b6-94d7-4976-8ea8-1221d52019c6 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:09.526479 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=79 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:47:09.657855 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d648c9b6-94d7-4976-8ea8-1221d52019c6 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:09.665724 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d648c9b6-94d7-4976-8ea8-1221d52019c6 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:09.667219 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d648c9b6-94d7-4976-8ea8-1221d52019c6 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:09.668405 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d648c9b6-94d7-4976-8ea8-1221d52019c6 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1726 microversion: 2.20 time: 0.160258 Aug 17 08:47:09.668969 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 408/804] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:47:09 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:47:09.690856 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f9b002ad-c6e5-41a5-ac06-1cc90143dda2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "766e35b8-045c-4684-900b-8853706528a3"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:47:09.693141 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f9b002ad-c6e5-41a5-ac06-1cc90143dda2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:09.700067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f9b002ad-c6e5-41a5-ac06-1cc90143dda2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:09.700536 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f9b002ad-c6e5-41a5-ac06-1cc90143dda2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:09.700955 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f9b002ad-c6e5-41a5-ac06-1cc90143dda2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:09.701627 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f9b002ad-c6e5-41a5-ac06-1cc90143dda2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:09.702066 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f9b002ad-c6e5-41a5-ac06-1cc90143dda2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:09.702475 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f9b002ad-c6e5-41a5-ac06-1cc90143dda2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:09.718974 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:47:09.983094 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f9b002ad-c6e5-41a5-ac06-1cc90143dda2 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "POST /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.296105 Aug 17 08:47:09.983707 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 397/805] 10.222.0.15 () {62 vars in 1364 bytes} [Wed Aug 17 08:47:09 2022] POST /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b/os-volume_attachments => generated 188 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 08:47:10.104507 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1be7ce83-d407-4cae-bac3-bf98f4cf0b1a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:10.104987 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1be7ce83-d407-4cae-bac3-bf98f4cf0b1a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:10.110786 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1be7ce83-d407-4cae-bac3-bf98f4cf0b1a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:10.111263 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1be7ce83-d407-4cae-bac3-bf98f4cf0b1a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:10.111737 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1be7ce83-d407-4cae-bac3-bf98f4cf0b1a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:10.112417 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1be7ce83-d407-4cae-bac3-bf98f4cf0b1a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:10.112867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1be7ce83-d407-4cae-bac3-bf98f4cf0b1a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:10.113289 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1be7ce83-d407-4cae-bac3-bf98f4cf0b1a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:10.342333 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1be7ce83-d407-4cae-bac3-bf98f4cf0b1a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b/os-volume_attachments/766e35b8-045c-4684-900b-8853706528a3" status: 202 len: 0 microversion: 2.20 time: 0.241871 Aug 17 08:47:10.342924 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 409/806] 10.222.0.15 () {60 vars in 1457 bytes} [Wed Aug 17 08:47:10 2022] DELETE /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b/os-volume_attachments/766e35b8-045c-4684-900b-8853706528a3 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 08:47:10.401087 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e668f398-bd96-4204-816c-754eadfb19fc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:47:10.401606 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e668f398-bd96-4204-816c-754eadfb19fc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:10.403418 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=31 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:47:10.410069 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e668f398-bd96-4204-816c-754eadfb19fc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:10.410548 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e668f398-bd96-4204-816c-754eadfb19fc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:10.410981 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e668f398-bd96-4204-816c-754eadfb19fc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:10.411726 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e668f398-bd96-4204-816c-754eadfb19fc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:10.412178 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e668f398-bd96-4204-816c-754eadfb19fc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:10.412597 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e668f398-bd96-4204-816c-754eadfb19fc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:10.441632 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e668f398-bd96-4204-816c-754eadfb19fc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127298) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 08:47:10.507237 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e668f398-bd96-4204-816c-754eadfb19fc tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "POST /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b/action" status: 202 len: 0 microversion: 2.20 time: 0.110558 Aug 17 08:47:10.507875 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 398/807] 10.222.0.15 () {62 vars in 1319 bytes} [Wed Aug 17 08:47:10 2022] POST /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 08:47:10.516603 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-879f42c7-80ba-4425-922a-886f516fd8f0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:10.517195 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-879f42c7-80ba-4425-922a-886f516fd8f0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:10.523512 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-879f42c7-80ba-4425-922a-886f516fd8f0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:10.524014 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-879f42c7-80ba-4425-922a-886f516fd8f0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:10.524437 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-879f42c7-80ba-4425-922a-886f516fd8f0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:10.525113 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-879f42c7-80ba-4425-922a-886f516fd8f0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:10.525598 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-879f42c7-80ba-4425-922a-886f516fd8f0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:10.526167 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-879f42c7-80ba-4425-922a-886f516fd8f0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:10.661584 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-879f42c7-80ba-4425-922a-886f516fd8f0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:10.669602 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-879f42c7-80ba-4425-922a-886f516fd8f0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:10.671086 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-879f42c7-80ba-4425-922a-886f516fd8f0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:10.672251 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-879f42c7-80ba-4425-922a-886f516fd8f0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1674 microversion: 2.20 time: 0.159537 Aug 17 08:47:10.672809 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 410/808] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:47:10 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:47:11.696368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1545764d-188e-4af3-abc8-04dd08b1b855 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:11.697631 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1545764d-188e-4af3-abc8-04dd08b1b855 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:11.703702 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1545764d-188e-4af3-abc8-04dd08b1b855 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:11.704175 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1545764d-188e-4af3-abc8-04dd08b1b855 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:11.704600 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1545764d-188e-4af3-abc8-04dd08b1b855 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:11.705272 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1545764d-188e-4af3-abc8-04dd08b1b855 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:11.705714 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1545764d-188e-4af3-abc8-04dd08b1b855 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:11.706127 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1545764d-188e-4af3-abc8-04dd08b1b855 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:11.916982 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1545764d-188e-4af3-abc8-04dd08b1b855 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:11.924871 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1545764d-188e-4af3-abc8-04dd08b1b855 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:11.926341 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1545764d-188e-4af3-abc8-04dd08b1b855 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:11.927462 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1545764d-188e-4af3-abc8-04dd08b1b855 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1732 microversion: 2.20 time: 0.235747 Aug 17 08:47:11.928050 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 399/809] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:47:11 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1732 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:47:12.277163 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-fa0be25a-b5a2-4c89-bf03-bf0ad00d6cca req-b8762106-f758-4099-869a-6f4bc6cf4b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f579cfbe-0b43-4710-8ba4-ba221a36e20b", "name": "network-vif-unplugged", "status": "completed", "tag": "fa872a89-5241-4d0c-9875-c10826245c65"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:47:12.287940 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-fa0be25a-b5a2-4c89-bf03-bf0ad00d6cca req-b8762106-f758-4099-869a-6f4bc6cf4b65 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:12.288424 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-fa0be25a-b5a2-4c89-bf03-bf0ad00d6cca req-b8762106-f758-4099-869a-6f4bc6cf4b65 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:12.288918 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-fa0be25a-b5a2-4c89-bf03-bf0ad00d6cca req-b8762106-f758-4099-869a-6f4bc6cf4b65 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:12.301056 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-fa0be25a-b5a2-4c89-bf03-bf0ad00d6cca req-b8762106-f758-4099-869a-6f4bc6cf4b65 service nova] Creating event network-vif-unplugged:fa872a89-5241-4d0c-9875-c10826245c65 for instance f579cfbe-0b43-4710-8ba4-ba221a36e20b on hv-cinder-85331 Aug 17 08:47:12.306145 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-fa0be25a-b5a2-4c89-bf03-bf0ad00d6cca req-b8762106-f758-4099-869a-6f4bc6cf4b65 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032766 Aug 17 08:47:12.307833 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 411/810] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:47:12.953877 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5669647e-c43e-4067-915c-5ca2a752e845 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:12.954467 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5669647e-c43e-4067-915c-5ca2a752e845 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:12.961526 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5669647e-c43e-4067-915c-5ca2a752e845 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:12.962015 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5669647e-c43e-4067-915c-5ca2a752e845 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:12.962446 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5669647e-c43e-4067-915c-5ca2a752e845 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:12.963410 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5669647e-c43e-4067-915c-5ca2a752e845 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:12.964079 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5669647e-c43e-4067-915c-5ca2a752e845 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:12.964699 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5669647e-c43e-4067-915c-5ca2a752e845 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:13.111022 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5669647e-c43e-4067-915c-5ca2a752e845 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:13.119754 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5669647e-c43e-4067-915c-5ca2a752e845 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:13.121250 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5669647e-c43e-4067-915c-5ca2a752e845 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:13.122379 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5669647e-c43e-4067-915c-5ca2a752e845 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1732 microversion: 2.20 time: 0.173058 Aug 17 08:47:13.122929 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 400/811] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:47:12 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:47:14.147306 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d2aa81bb-bad9-4a31-b345-5d61215c2c20 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:14.148134 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d2aa81bb-bad9-4a31-b345-5d61215c2c20 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:14.155015 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2aa81bb-bad9-4a31-b345-5d61215c2c20 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:14.155598 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2aa81bb-bad9-4a31-b345-5d61215c2c20 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:14.156116 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2aa81bb-bad9-4a31-b345-5d61215c2c20 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:14.156879 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2aa81bb-bad9-4a31-b345-5d61215c2c20 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:14.157401 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2aa81bb-bad9-4a31-b345-5d61215c2c20 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:14.157891 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d2aa81bb-bad9-4a31-b345-5d61215c2c20 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:14.306708 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d2aa81bb-bad9-4a31-b345-5d61215c2c20 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:14.314999 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d2aa81bb-bad9-4a31-b345-5d61215c2c20 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:14.316549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d2aa81bb-bad9-4a31-b345-5d61215c2c20 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:14.317720 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d2aa81bb-bad9-4a31-b345-5d61215c2c20 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1732 microversion: 2.20 time: 0.175650 Aug 17 08:47:14.318512 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 412/812] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:47:14 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:47:15.342953 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f151ed9a-4b84-43fd-8e20-3ff9ac4c68c0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:15.344421 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f151ed9a-4b84-43fd-8e20-3ff9ac4c68c0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:15.350797 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f151ed9a-4b84-43fd-8e20-3ff9ac4c68c0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:15.351480 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f151ed9a-4b84-43fd-8e20-3ff9ac4c68c0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:15.352038 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f151ed9a-4b84-43fd-8e20-3ff9ac4c68c0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:15.352792 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f151ed9a-4b84-43fd-8e20-3ff9ac4c68c0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:15.353399 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f151ed9a-4b84-43fd-8e20-3ff9ac4c68c0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:15.353877 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f151ed9a-4b84-43fd-8e20-3ff9ac4c68c0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:15.510672 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f151ed9a-4b84-43fd-8e20-3ff9ac4c68c0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:15.518606 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f151ed9a-4b84-43fd-8e20-3ff9ac4c68c0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:15.520121 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f151ed9a-4b84-43fd-8e20-3ff9ac4c68c0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:15.521244 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f151ed9a-4b84-43fd-8e20-3ff9ac4c68c0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1732 microversion: 2.20 time: 0.183958 Aug 17 08:47:15.521794 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 401/813] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:47:15 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:47:16.544525 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b3822f9b-de6a-4538-a6f1-15a96cfe5e78 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:16.545119 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b3822f9b-de6a-4538-a6f1-15a96cfe5e78 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:16.551481 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b3822f9b-de6a-4538-a6f1-15a96cfe5e78 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:16.551987 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b3822f9b-de6a-4538-a6f1-15a96cfe5e78 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:16.552428 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b3822f9b-de6a-4538-a6f1-15a96cfe5e78 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:16.553115 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b3822f9b-de6a-4538-a6f1-15a96cfe5e78 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:16.553558 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b3822f9b-de6a-4538-a6f1-15a96cfe5e78 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:16.553973 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b3822f9b-de6a-4538-a6f1-15a96cfe5e78 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:16.705448 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b3822f9b-de6a-4538-a6f1-15a96cfe5e78 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:16.714768 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b3822f9b-de6a-4538-a6f1-15a96cfe5e78 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:16.716544 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b3822f9b-de6a-4538-a6f1-15a96cfe5e78 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:16.717720 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b3822f9b-de6a-4538-a6f1-15a96cfe5e78 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1732 microversion: 2.20 time: 0.177071 Aug 17 08:47:16.718278 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 413/814] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:47:16 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:47:17.739213 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-45771796-5bf5-4f6e-aa15-4596c9e130eb tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:17.739947 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-45771796-5bf5-4f6e-aa15-4596c9e130eb tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:17.746879 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-45771796-5bf5-4f6e-aa15-4596c9e130eb tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:17.747353 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-45771796-5bf5-4f6e-aa15-4596c9e130eb tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:17.747800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-45771796-5bf5-4f6e-aa15-4596c9e130eb tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:17.748478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-45771796-5bf5-4f6e-aa15-4596c9e130eb tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:17.748920 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-45771796-5bf5-4f6e-aa15-4596c9e130eb tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:17.749335 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-45771796-5bf5-4f6e-aa15-4596c9e130eb tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:17.895780 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-45771796-5bf5-4f6e-aa15-4596c9e130eb tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:17.905304 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-45771796-5bf5-4f6e-aa15-4596c9e130eb tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:17.906778 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-45771796-5bf5-4f6e-aa15-4596c9e130eb tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:17.907938 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-45771796-5bf5-4f6e-aa15-4596c9e130eb tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1732 microversion: 2.20 time: 0.172526 Aug 17 08:47:17.908487 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 402/815] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:47:17 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:47:18.933131 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ef8d0c1c-6294-467d-b079-7bdcc5f98df1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:18.933794 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ef8d0c1c-6294-467d-b079-7bdcc5f98df1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:18.941090 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ef8d0c1c-6294-467d-b079-7bdcc5f98df1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:18.941599 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ef8d0c1c-6294-467d-b079-7bdcc5f98df1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:18.942193 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ef8d0c1c-6294-467d-b079-7bdcc5f98df1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:18.942938 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ef8d0c1c-6294-467d-b079-7bdcc5f98df1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:18.943338 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ef8d0c1c-6294-467d-b079-7bdcc5f98df1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:18.943780 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ef8d0c1c-6294-467d-b079-7bdcc5f98df1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:19.083117 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ef8d0c1c-6294-467d-b079-7bdcc5f98df1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:19.092007 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ef8d0c1c-6294-467d-b079-7bdcc5f98df1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:19.093504 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ef8d0c1c-6294-467d-b079-7bdcc5f98df1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:19.094676 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ef8d0c1c-6294-467d-b079-7bdcc5f98df1 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1732 microversion: 2.20 time: 0.166673 Aug 17 08:47:19.095232 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 414/816] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:47:18 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:47:20.118173 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-b67230cf-4408-4f9d-ae3c-f96c04228272 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:20.118867 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-b67230cf-4408-4f9d-ae3c-f96c04228272 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:20.125189 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b67230cf-4408-4f9d-ae3c-f96c04228272 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:20.125659 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b67230cf-4408-4f9d-ae3c-f96c04228272 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:20.126084 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b67230cf-4408-4f9d-ae3c-f96c04228272 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:20.126750 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b67230cf-4408-4f9d-ae3c-f96c04228272 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:20.127192 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b67230cf-4408-4f9d-ae3c-f96c04228272 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:20.127625 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-b67230cf-4408-4f9d-ae3c-f96c04228272 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:20.263284 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b67230cf-4408-4f9d-ae3c-f96c04228272 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:20.271127 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b67230cf-4408-4f9d-ae3c-f96c04228272 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:20.272676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-b67230cf-4408-4f9d-ae3c-f96c04228272 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:20.273799 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-b67230cf-4408-4f9d-ae3c-f96c04228272 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1732 microversion: 2.20 time: 0.159471 Aug 17 08:47:20.274351 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 403/817] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:47:20 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:47:21.296838 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1cd93676-12a7-4b22-9173-c418c720f021 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:21.297434 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1cd93676-12a7-4b22-9173-c418c720f021 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:21.303943 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1cd93676-12a7-4b22-9173-c418c720f021 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:21.304417 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1cd93676-12a7-4b22-9173-c418c720f021 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:21.304842 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1cd93676-12a7-4b22-9173-c418c720f021 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:21.305523 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1cd93676-12a7-4b22-9173-c418c720f021 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:21.306027 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1cd93676-12a7-4b22-9173-c418c720f021 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:21.306489 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1cd93676-12a7-4b22-9173-c418c720f021 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:21.444151 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-1cd93676-12a7-4b22-9173-c418c720f021 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:21.454744 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-1cd93676-12a7-4b22-9173-c418c720f021 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:21.456345 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-1cd93676-12a7-4b22-9173-c418c720f021 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:21.457492 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1cd93676-12a7-4b22-9173-c418c720f021 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1732 microversion: 2.20 time: 0.164555 Aug 17 08:47:21.458057 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 415/818] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:47:21 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:47:21.555624 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-cbfedbe6-09b2-4d77-8d58-cb7b38eda428 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:21.556202 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-cbfedbe6-09b2-4d77-8d58-cb7b38eda428 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 43b85b50-c35a-4f5e-a5cc-c67859166b3c] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:21.562473 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cbfedbe6-09b2-4d77-8d58-cb7b38eda428 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:21.562939 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cbfedbe6-09b2-4d77-8d58-cb7b38eda428 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:21.563373 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cbfedbe6-09b2-4d77-8d58-cb7b38eda428 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:21.564057 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cbfedbe6-09b2-4d77-8d58-cb7b38eda428 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:21.564497 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cbfedbe6-09b2-4d77-8d58-cb7b38eda428 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:21.564905 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-cbfedbe6-09b2-4d77-8d58-cb7b38eda428 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:21.588668 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-cbfedbe6-09b2-4d77-8d58-cb7b38eda428 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c/ips" status: 200 len: 150 microversion: 2.1 time: 0.036844 Aug 17 08:47:21.589241 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 404/819] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 08:47:21 2022] GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:47:22.482147 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-fe2e469d-3aa7-47e0-be2a-478b9c024bf0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:22.482742 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fe2e469d-3aa7-47e0-be2a-478b9c024bf0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:22.489145 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fe2e469d-3aa7-47e0-be2a-478b9c024bf0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:22.489605 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fe2e469d-3aa7-47e0-be2a-478b9c024bf0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:22.490030 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fe2e469d-3aa7-47e0-be2a-478b9c024bf0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:22.490696 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fe2e469d-3aa7-47e0-be2a-478b9c024bf0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:22.491134 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fe2e469d-3aa7-47e0-be2a-478b9c024bf0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:22.491564 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fe2e469d-3aa7-47e0-be2a-478b9c024bf0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:22.621471 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-fe2e469d-3aa7-47e0-be2a-478b9c024bf0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:22.629709 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-fe2e469d-3aa7-47e0-be2a-478b9c024bf0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:22.631205 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-fe2e469d-3aa7-47e0-be2a-478b9c024bf0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:22.632386 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-fe2e469d-3aa7-47e0-be2a-478b9c024bf0 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1732 microversion: 2.20 time: 0.154138 Aug 17 08:47:22.633147 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 416/820] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:47:22 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:47:22.914467 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-04729f11-aebe-4585-ba35-48756be11f32 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b4721da-8bf8-44e3-af48-540d114216d4"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:47:22.917551 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-04729f11-aebe-4585-ba35-48756be11f32 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 43b85b50-c35a-4f5e-a5cc-c67859166b3c] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:22.924417 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-04729f11-aebe-4585-ba35-48756be11f32 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:22.924871 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-04729f11-aebe-4585-ba35-48756be11f32 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:22.925295 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-04729f11-aebe-4585-ba35-48756be11f32 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:22.925969 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-04729f11-aebe-4585-ba35-48756be11f32 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:22.926504 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-04729f11-aebe-4585-ba35-48756be11f32 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:22.926827 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-04729f11-aebe-4585-ba35-48756be11f32 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:23.189643 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-04729f11-aebe-4585-ba35-48756be11f32 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "POST /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279080 Aug 17 08:47:23.190245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 405/821] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 08:47:22 2022] POST /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:47:23.655648 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-111850b3-3161-43cb-94ac-685038129c9a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:23.656246 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-111850b3-3161-43cb-94ac-685038129c9a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:23.662670 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-111850b3-3161-43cb-94ac-685038129c9a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:23.663167 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-111850b3-3161-43cb-94ac-685038129c9a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:23.663618 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-111850b3-3161-43cb-94ac-685038129c9a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:23.664293 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-111850b3-3161-43cb-94ac-685038129c9a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:23.664733 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-111850b3-3161-43cb-94ac-685038129c9a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:23.665658 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-111850b3-3161-43cb-94ac-685038129c9a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:23.798306 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-111850b3-3161-43cb-94ac-685038129c9a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:23.806183 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-111850b3-3161-43cb-94ac-685038129c9a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:23.807689 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-111850b3-3161-43cb-94ac-685038129c9a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:23.808814 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-111850b3-3161-43cb-94ac-685038129c9a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1719 microversion: 2.20 time: 0.157094 Aug 17 08:47:23.809360 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 417/822] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:47:23 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:47:26.373211 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-aebe7bb0-0eb9-424c-8d5a-a82ca84bb845 req-b6876f5c-d152-4ca6-ac2a-fb0f2727efe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f579cfbe-0b43-4710-8ba4-ba221a36e20b", "name": "network-vif-plugged", "status": "completed", "tag": "fa872a89-5241-4d0c-9875-c10826245c65"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:47:26.385167 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-aebe7bb0-0eb9-424c-8d5a-a82ca84bb845 req-b6876f5c-d152-4ca6-ac2a-fb0f2727efe3 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:26.385167 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-aebe7bb0-0eb9-424c-8d5a-a82ca84bb845 req-b6876f5c-d152-4ca6-ac2a-fb0f2727efe3 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:26.385167 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-aebe7bb0-0eb9-424c-8d5a-a82ca84bb845 req-b6876f5c-d152-4ca6-ac2a-fb0f2727efe3 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:26.397031 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-aebe7bb0-0eb9-424c-8d5a-a82ca84bb845 req-b6876f5c-d152-4ca6-ac2a-fb0f2727efe3 service nova] Creating event network-vif-plugged:fa872a89-5241-4d0c-9875-c10826245c65 for instance f579cfbe-0b43-4710-8ba4-ba221a36e20b on hv-cinder-85331 Aug 17 08:47:26.403195 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-aebe7bb0-0eb9-424c-8d5a-a82ca84bb845 req-b6876f5c-d152-4ca6-ac2a-fb0f2727efe3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034619 Aug 17 08:47:26.404456 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 406/823] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:47:30.709906 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-95d2ad0b-aab8-4f4b-b14d-42b2058f95a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b4721da-8bf8-44e3-af48-540d114216d4"}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:47:30.712989 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-95d2ad0b-aab8-4f4b-b14d-42b2058f95a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 43b85b50-c35a-4f5e-a5cc-c67859166b3c] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:30.719289 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95d2ad0b-aab8-4f4b-b14d-42b2058f95a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:30.719805 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95d2ad0b-aab8-4f4b-b14d-42b2058f95a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:30.720242 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95d2ad0b-aab8-4f4b-b14d-42b2058f95a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:30.720918 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95d2ad0b-aab8-4f4b-b14d-42b2058f95a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:30.721365 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95d2ad0b-aab8-4f4b-b14d-42b2058f95a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:30.721779 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95d2ad0b-aab8-4f4b-b14d-42b2058f95a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:30.799216 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-95d2ad0b-aab8-4f4b-b14d-42b2058f95a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] HTTP exception thrown: Invalid volume: volume 2b4721da-8bf8-44e3-af48-540d114216d4 is already attached to instances: 43b85b50-c35a-4f5e-a5cc-c67859166b3c Aug 17 08:47:30.800922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-95d2ad0b-aab8-4f4b-b14d-42b2058f95a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Request method failure captured: Aug 17 08:47:30.800922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: POST /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c/os-volume_attachments HTTP/1.1 Aug 17 08:47:30.800922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:47:30.800922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:47:30.800922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:47:30.800922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 74 Aug 17 08:47:30.800922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:47:30.800922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:47:30.800922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:47:30.800922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:47:30.800922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_KpFdcvpXRpf5-5Y1Bcdp25cETTaZP2GCfDiMsQtuC72_QvaOW9RGOTA8kn7uQkIZJZ1MZAapBPaWHtaHUw4ZxHYKXMP1ga8b2c-T6hV70Qk5k-OaBMweSR-NFttqfscTAbrcBgHODlMBBOScpWQJnArcc-Q8jX8Dn-V-35da8hxuVI Aug 17 08:47:30.800922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:47:30.800922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:47:30.800922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:47:30.800922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:47:30.800922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:47:30.800922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:47:30.800922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:47:30.800922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:47:30.800922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:47:30.800922 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:47:30.802617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_34b106e46b2c4fb292353a6176c9f699", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:47:30.802617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:47:30.802617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:47:30.802617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:47:30.802617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:47:30.802617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:47:30.802617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:47:30.802617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: 49114d25c04144269e3eb88448e2c2ee Aug 17 08:47:30.802617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:47:30.802617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Aug 17 08:47:30.802617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {"volumeAttachment": {"volumeId": "2b4721da-8bf8-44e3-af48-540d114216d4"}} Aug 17 08:47:30.802617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: > Aug 17 08:47:30.804343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Invalid volume: volume 2b4721da-8bf8-44e3-af48-540d114216d4 is already attached to instances: 43b85b50-c35a-4f5e-a5cc-c67859166b3c Aug 17 08:47:30.804343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'server_id': '43b85b50-c35a-4f5e-a5cc-c67859166b3c', 'body': {'volumeAttachment': {'volumeId': '2b4721da-8bf8-44e3-af48-540d114216d4'}}} Aug 17 08:47:30.804343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:47:30.804343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:47:30.804343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 08:47:30.804343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 08:47:30.804343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 08:47:30.804343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 08:47:30.804343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 17 08:47:30.804343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 17 08:47:30.804343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 17 08:47:30.804343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 17 08:47:30.804343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 17 08:47:30.804343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 17 08:47:30.804343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2b4721da-8bf8-44e3-af48-540d114216d4 is already attached to instances: 43b85b50-c35a-4f5e-a5cc-c67859166b3c Aug 17 08:47:30.804343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:47:30.804343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:47:30.804343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:47:30.804343 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:47:30.806522 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:47:30.806522 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:47:30.806522 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:47:30.806522 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:47:30.806522 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:47:30.806522 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:47:30.806522 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 08:47:30.806522 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 08:47:30.806522 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 08:47:30.806522 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 08:47:30.806522 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 08:47:30.806522 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 08:47:30.806522 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 17 08:47:30.806522 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 17 08:47:30.806522 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2b4721da-8bf8-44e3-af48-540d114216d4 is already attached to instances: 43b85b50-c35a-4f5e-a5cc-c67859166b3c Aug 17 08:47:30.806522 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:47:30.806522 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:47:30.806522 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:47:30.806522 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:47:30.806522 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:47:30.807978 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:47:30.807978 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:47:30.807978 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:47:30.807978 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2b4721da-8bf8-44e3-af48-540d114216d4 is already attached to instances: 43b85b50-c35a-4f5e-a5cc-c67859166b3c Aug 17 08:47:30.807978 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:47:30.807978 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-95d2ad0b-aab8-4f4b-b14d-42b2058f95a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Returning 400 to user: Invalid volume: volume 2b4721da-8bf8-44e3-af48-540d114216d4 is already attached to instances: 43b85b50-c35a-4f5e-a5cc-c67859166b3c {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:47:30.807978 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-95d2ad0b-aab8-4f4b-b14d-42b2058f95a7 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "POST /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097011 Aug 17 08:47:30.807978 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 418/824] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 08:47:30 2022] POST /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 08:47:30.866219 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-39574ac7-d3b9-49b3-8237-a9cfe807dc7e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:30.866779 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-39574ac7-d3b9-49b3-8237-a9cfe807dc7e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 43b85b50-c35a-4f5e-a5cc-c67859166b3c] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:30.873380 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39574ac7-d3b9-49b3-8237-a9cfe807dc7e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:30.873836 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39574ac7-d3b9-49b3-8237-a9cfe807dc7e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:30.874257 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39574ac7-d3b9-49b3-8237-a9cfe807dc7e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:30.874931 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39574ac7-d3b9-49b3-8237-a9cfe807dc7e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:30.875387 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39574ac7-d3b9-49b3-8237-a9cfe807dc7e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:30.875827 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39574ac7-d3b9-49b3-8237-a9cfe807dc7e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:30.954147 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-39574ac7-d3b9-49b3-8237-a9cfe807dc7e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lazy-loading 'services' on Instance uuid 43b85b50-c35a-4f5e-a5cc-c67859166b3c {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:47:31.024386 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-39574ac7-d3b9-49b3-8237-a9cfe807dc7e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "DELETE /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c/os-volume_attachments/2b4721da-8bf8-44e3-af48-540d114216d4" status: 202 len: 0 microversion: 2.1 time: 0.162920 Aug 17 08:47:31.024978 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 407/825] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 08:47:30 2022] DELETE /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c/os-volume_attachments/2b4721da-8bf8-44e3-af48-540d114216d4 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 08:47:31.034329 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f77963a7-7d2c-4f07-99c5-1d0f61ee854f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:31.036535 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f77963a7-7d2c-4f07-99c5-1d0f61ee854f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 43b85b50-c35a-4f5e-a5cc-c67859166b3c] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:31.044476 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f77963a7-7d2c-4f07-99c5-1d0f61ee854f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:31.045175 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f77963a7-7d2c-4f07-99c5-1d0f61ee854f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:31.045657 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f77963a7-7d2c-4f07-99c5-1d0f61ee854f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:31.046290 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f77963a7-7d2c-4f07-99c5-1d0f61ee854f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:31.046735 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f77963a7-7d2c-4f07-99c5-1d0f61ee854f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:31.047153 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f77963a7-7d2c-4f07-99c5-1d0f61ee854f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:31.076511 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f77963a7-7d2c-4f07-99c5-1d0f61ee854f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047243 Aug 17 08:47:31.077061 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 419/826] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 08:47:31 2022] GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:47:32.089903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f3bb5485-ab55-43a5-8777-1b5b70897938 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:32.092173 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f3bb5485-ab55-43a5-8777-1b5b70897938 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 43b85b50-c35a-4f5e-a5cc-c67859166b3c] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:32.098310 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f3bb5485-ab55-43a5-8777-1b5b70897938 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:32.098781 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f3bb5485-ab55-43a5-8777-1b5b70897938 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:32.099204 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f3bb5485-ab55-43a5-8777-1b5b70897938 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:32.099910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f3bb5485-ab55-43a5-8777-1b5b70897938 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:32.100358 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f3bb5485-ab55-43a5-8777-1b5b70897938 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:32.100775 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f3bb5485-ab55-43a5-8777-1b5b70897938 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:32.281048 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f3bb5485-ab55-43a5-8777-1b5b70897938 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.196549 Aug 17 08:47:32.281597 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 408/827] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 08:47:32 2022] GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c/os-volume_attachments => generated 25 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 08:47:32.341947 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-69055a0e-774f-4ad4-8383-610c94bbbbbc tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:32.342416 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-69055a0e-774f-4ad4-8383-610c94bbbbbc tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 43b85b50-c35a-4f5e-a5cc-c67859166b3c] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:32.348668 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-69055a0e-774f-4ad4-8383-610c94bbbbbc tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:32.349136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-69055a0e-774f-4ad4-8383-610c94bbbbbc tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:32.349558 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-69055a0e-774f-4ad4-8383-610c94bbbbbc tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:32.350225 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-69055a0e-774f-4ad4-8383-610c94bbbbbc tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:32.350664 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-69055a0e-774f-4ad4-8383-610c94bbbbbc tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:32.351075 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-69055a0e-774f-4ad4-8383-610c94bbbbbc tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:32.375467 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-69055a0e-774f-4ad4-8383-610c94bbbbbc tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 43b85b50-c35a-4f5e-a5cc-c67859166b3c] Going to try to terminate instance {{(pid=127297) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 08:47:32.450025 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-69055a0e-774f-4ad4-8383-610c94bbbbbc tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "DELETE /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c" status: 204 len: 0 microversion: 2.1 time: 0.111204 Aug 17 08:47:32.451044 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 420/828] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:47:32 2022] DELETE /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 08:47:32.458958 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-fe40bddd-f2b7-42f0-8583-59fc4c5cc759 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:32.459565 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-fe40bddd-f2b7-42f0-8583-59fc4c5cc759 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 43b85b50-c35a-4f5e-a5cc-c67859166b3c] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:32.465916 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fe40bddd-f2b7-42f0-8583-59fc4c5cc759 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:32.466388 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fe40bddd-f2b7-42f0-8583-59fc4c5cc759 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:32.466812 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fe40bddd-f2b7-42f0-8583-59fc4c5cc759 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:32.467481 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fe40bddd-f2b7-42f0-8583-59fc4c5cc759 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:32.467985 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fe40bddd-f2b7-42f0-8583-59fc4c5cc759 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:32.468402 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-fe40bddd-f2b7-42f0-8583-59fc4c5cc759 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:32.486580 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=6,nova_cell1:UPDATE=7 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:47:32.602501 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-fe40bddd-f2b7-42f0-8583-59fc4c5cc759 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:32.610073 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-fe40bddd-f2b7-42f0-8583-59fc4c5cc759 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c" status: 200 len: 1682 microversion: 2.1 time: 0.154894 Aug 17 08:47:32.610633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 409/829] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:32 2022] GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:47:33.631275 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5d90c90e-1d4f-4701-afd4-d16834195505 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:33.632015 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-5d90c90e-1d4f-4701-afd4-d16834195505 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 43b85b50-c35a-4f5e-a5cc-c67859166b3c] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:33.638119 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5d90c90e-1d4f-4701-afd4-d16834195505 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:33.638598 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5d90c90e-1d4f-4701-afd4-d16834195505 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:33.639019 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5d90c90e-1d4f-4701-afd4-d16834195505 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:33.639721 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5d90c90e-1d4f-4701-afd4-d16834195505 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:33.640164 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5d90c90e-1d4f-4701-afd4-d16834195505 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:33.640577 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5d90c90e-1d4f-4701-afd4-d16834195505 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:33.644563 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:47:33.770549 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-5d90c90e-1d4f-4701-afd4-d16834195505 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:33.778464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-5d90c90e-1d4f-4701-afd4-d16834195505 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c" status: 200 len: 1682 microversion: 2.1 time: 0.151408 Aug 17 08:47:33.779025 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 421/830] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:33 2022] GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:47:34.800031 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-5c164956-9cef-4fb5-9d36-81216a495770 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:34.800768 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-5c164956-9cef-4fb5-9d36-81216a495770 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 43b85b50-c35a-4f5e-a5cc-c67859166b3c] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:34.808123 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5c164956-9cef-4fb5-9d36-81216a495770 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:34.808595 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5c164956-9cef-4fb5-9d36-81216a495770 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:34.809020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5c164956-9cef-4fb5-9d36-81216a495770 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:34.809732 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5c164956-9cef-4fb5-9d36-81216a495770 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:34.810175 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5c164956-9cef-4fb5-9d36-81216a495770 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:34.810590 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-5c164956-9cef-4fb5-9d36-81216a495770 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:34.880020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-5c164956-9cef-4fb5-9d36-81216a495770 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:34.887688 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-5c164956-9cef-4fb5-9d36-81216a495770 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c" status: 200 len: 1614 microversion: 2.1 time: 0.091405 Aug 17 08:47:34.899874 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 410/831] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:34 2022] GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c => generated 1614 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:47:34.941956 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-8232e8a8-5f7d-4da0-8ab6-bf12a6ad57ea req-65d81208-9ec6-4694-8346-08a327f744ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43b85b50-c35a-4f5e-a5cc-c67859166b3c", "name": "network-vif-deleted", "tag": "7c6f2f32-18eb-4912-aff5-95be684b5ac7"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:47:34.952665 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-8232e8a8-5f7d-4da0-8ab6-bf12a6ad57ea req-65d81208-9ec6-4694-8346-08a327f744ec service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:34.953249 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-8232e8a8-5f7d-4da0-8ab6-bf12a6ad57ea req-65d81208-9ec6-4694-8346-08a327f744ec service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:34.953755 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-8232e8a8-5f7d-4da0-8ab6-bf12a6ad57ea req-65d81208-9ec6-4694-8346-08a327f744ec service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:34.965471 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-8232e8a8-5f7d-4da0-8ab6-bf12a6ad57ea req-65d81208-9ec6-4694-8346-08a327f744ec service nova] Creating event network-vif-deleted:7c6f2f32-18eb-4912-aff5-95be684b5ac7 for instance 43b85b50-c35a-4f5e-a5cc-c67859166b3c on hv-cinder-85331 Aug 17 08:47:34.970841 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-8232e8a8-5f7d-4da0-8ab6-bf12a6ad57ea req-65d81208-9ec6-4694-8346-08a327f744ec service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032908 Aug 17 08:47:34.972018 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 422/832] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:47:35.908697 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-014940a9-1749-4413-bcdf-2c54b49a0558 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:35.909372 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-014940a9-1749-4413-bcdf-2c54b49a0558 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 43b85b50-c35a-4f5e-a5cc-c67859166b3c] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:35.915792 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-014940a9-1749-4413-bcdf-2c54b49a0558 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:35.916269 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-014940a9-1749-4413-bcdf-2c54b49a0558 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:35.916689 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-014940a9-1749-4413-bcdf-2c54b49a0558 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:35.917371 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-014940a9-1749-4413-bcdf-2c54b49a0558 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:35.917811 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-014940a9-1749-4413-bcdf-2c54b49a0558 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:35.918281 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-014940a9-1749-4413-bcdf-2c54b49a0558 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:35.932095 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-014940a9-1749-4413-bcdf-2c54b49a0558 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] HTTP exception thrown: Instance 43b85b50-c35a-4f5e-a5cc-c67859166b3c could not be found. Aug 17 08:47:35.933701 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-014940a9-1749-4413-bcdf-2c54b49a0558 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Request method failure captured: Aug 17 08:47:35.933701 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c HTTP/1.1 Aug 17 08:47:35.933701 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:47:35.933701 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:47:35.933701 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:47:35.933701 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:47:35.933701 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:47:35.933701 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:47:35.933701 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:47:35.933701 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:47:35.933701 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_KpFdcvpXRpf5-5Y1Bcdp25cETTaZP2GCfDiMsQtuC72_QvaOW9RGOTA8kn7uQkIZJZ1MZAapBPaWHtaHUw4ZxHYKXMP1ga8b2c-T6hV70Qk5k-OaBMweSR-NFttqfscTAbrcBgHODlMBBOScpWQJnArcc-Q8jX8Dn-V-35da8hxuVI Aug 17 08:47:35.933701 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:47:35.933701 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:47:35.933701 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:47:35.933701 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:47:35.933701 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:47:35.933701 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:47:35.933701 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:47:35.933701 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:47:35.933701 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:47:35.933701 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:47:35.935422 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_34b106e46b2c4fb292353a6176c9f699", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:47:35.935422 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:47:35.935422 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:47:35.935422 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:47:35.935422 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:47:35.935422 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:47:35.935422 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:47:35.935422 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: 49114d25c04144269e3eb88448e2c2ee Aug 17 08:47:35.935422 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:47:35.935422 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:47:35.935422 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Instance 43b85b50-c35a-4f5e-a5cc-c67859166b3c could not be found. Aug 17 08:47:35.935422 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'id': '43b85b50-c35a-4f5e-a5cc-c67859166b3c'} Aug 17 08:47:35.936506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:47:35.936506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:47:35.936506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:47:35.936506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:47:35.936506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:47:35.936506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:47:35.936506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:47:35.936506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:47:35.936506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:47:35.936506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:47:35.936506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43b85b50-c35a-4f5e-a5cc-c67859166b3c could not be found. Aug 17 08:47:35.936506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:47:35.936506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:47:35.936506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:47:35.936506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:47:35.936506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:47:35.936506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:47:35.936506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:47:35.936506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:47:35.936506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:47:35.938080 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:47:35.938080 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:47:35.938080 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:47:35.938080 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:47:35.938080 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:47:35.938080 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:47:35.938080 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:47:35.938080 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43b85b50-c35a-4f5e-a5cc-c67859166b3c could not be found. Aug 17 08:47:35.938080 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:47:35.938080 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:47:35.938080 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:47:35.938080 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:47:35.938080 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:47:35.938080 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:47:35.938080 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:47:35.938080 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:47:35.938080 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43b85b50-c35a-4f5e-a5cc-c67859166b3c could not be found. Aug 17 08:47:35.938080 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:47:35.939522 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-014940a9-1749-4413-bcdf-2c54b49a0558 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Returning 404 to user: Instance 43b85b50-c35a-4f5e-a5cc-c67859166b3c could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:47:35.939522 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-014940a9-1749-4413-bcdf-2c54b49a0558 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c" status: 404 len: 111 microversion: 2.1 time: 0.030542 Aug 17 08:47:35.939522 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 411/833] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:35 2022] GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:47:35.944736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-711537e5-d405-4c90-a0a8-a19bbbdfa45f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '.version_select at 0x7f3f8529c280>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:35.963392 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-711537e5-d405-4c90-a0a8-a19bbbdfa45f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140846401" status: 202 len: 0 microversion: 2.1 time: 0.022738 Aug 17 08:47:35.963990 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 423/834] 10.222.0.15 () {58 vars in 1221 bytes} [Wed Aug 17 08:47:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140846401 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:47:36.812099 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3d5aa505-a8bb-4c8e-85ca-2f8013598ff5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Action: 'create', calling method: .version_select at 0x7f3f851b14c0>, body: {"keypair": {"name": "tempest-keypair-301939902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQX1cs7KwCB61Mb0aWwsT2e/z3XWfN9TiaBVgL72am8f2vU7d2xjuVPE/L2dwXXwAJEFQ9GmNGW2uIgcr5/+4aCUiUnaF/rkgibuZXeA6M2ts2J+NqhQpzhsNZmqJJ+ng=="}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:47:36.827770 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-3d5aa505-a8bb-4c8e-85ca-2f8013598ff5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Getting quotas for project 34b106e46b2c4fb292353a6176c9f699. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:47:36.831527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-3d5aa505-a8bb-4c8e-85ca-2f8013598ff5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Getting quotas for user 49114d25c04144269e3eb88448e2c2ee and project 34b106e46b2c4fb292353a6176c9f699. Resources: {'key_pairs'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:47:36.853614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3d5aa505-a8bb-4c8e-85ca-2f8013598ff5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045429 Aug 17 08:47:36.854173 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 412/835] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 08:47:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:47:38.026776 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-49946bb3-7227-4421-be40-42f588718dfa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1106021092", "imageRef": "4467450c-a35c-42e3-af85-a13291b0b2aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "57fc802a-439c-414a-9558-62dc475889bd"}], "security_groups": [{"name": "tempest-securitygroup--1361574651"}], "key_name": "tempest-keypair-301939902", "user_data": "}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:47:38.130485 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.network.neutron [None req-49946bb3-7227-4421-be40-42f588718dfa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] validate_networks() for [('57fc802a-439c-414a-9558-62dc475889bd', None, None, None, None, None)] {{(pid=127297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 08:47:38.714425 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-49946bb3-7227-4421-be40-42f588718dfa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Flavor limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 08:47:38.714839 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-49946bb3-7227-4421-be40-42f588718dfa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Image limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 08:47:38.715327 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-49946bb3-7227-4421-be40-42f588718dfa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Flavor pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 08:47:38.715755 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-49946bb3-7227-4421-be40-42f588718dfa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Image pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 08:47:38.716160 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-49946bb3-7227-4421-be40-42f588718dfa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 08:47:38.724799 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-49946bb3-7227-4421-be40-42f588718dfa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:38.725299 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-49946bb3-7227-4421-be40-42f588718dfa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:38.725729 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-49946bb3-7227-4421-be40-42f588718dfa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:38.726489 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-49946bb3-7227-4421-be40-42f588718dfa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:38.726997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-49946bb3-7227-4421-be40-42f588718dfa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:38.727411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-49946bb3-7227-4421-be40-42f588718dfa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:38.744031 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-49946bb3-7227-4421-be40-42f588718dfa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Getting quotas for project 34b106e46b2c4fb292353a6176c9f699. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:47:38.748030 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-49946bb3-7227-4421-be40-42f588718dfa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Getting quotas for user 49114d25c04144269e3eb88448e2c2ee and project 34b106e46b2c4fb292353a6176c9f699. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:47:38.759221 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-49946bb3-7227-4421-be40-42f588718dfa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Going to run 1 instances... {{(pid=127297) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 08:47:38.761545 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-49946bb3-7227-4421-be40-42f588718dfa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 72836909-95a3-4172-adcb-33fd1456a1f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4467450c-a35c-42e3-af85-a13291b0b2aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 08:47:38.806126 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-49946bb3-7227-4421-be40-42f588718dfa tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.784153 Aug 17 08:47:38.806764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 424/836] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 08:47:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 08:47:38.817506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0e6dff7f-a124-4892-9996-d5816502101d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:38.818195 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0e6dff7f-a124-4892-9996-d5816502101d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 72836909-95a3-4172-adcb-33fd1456a1f2] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:38.872975 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0e6dff7f-a124-4892-9996-d5816502101d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:38.879665 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0e6dff7f-a124-4892-9996-d5816502101d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2" status: 200 len: 1241 microversion: 2.1 time: 0.066040 Aug 17 08:47:38.880437 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 413/837] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:38 2022] GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:47:39.901964 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-db61778b-a9cf-4e87-990e-756b32557b1d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:39.902565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-db61778b-a9cf-4e87-990e-756b32557b1d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 72836909-95a3-4172-adcb-33fd1456a1f2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:39.905169 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:47:39.910377 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-db61778b-a9cf-4e87-990e-756b32557b1d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:39.910863 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-db61778b-a9cf-4e87-990e-756b32557b1d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:39.911290 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-db61778b-a9cf-4e87-990e-756b32557b1d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:39.911995 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-db61778b-a9cf-4e87-990e-756b32557b1d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:39.912440 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-db61778b-a9cf-4e87-990e-756b32557b1d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:39.912857 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-db61778b-a9cf-4e87-990e-756b32557b1d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:39.982633 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-db61778b-a9cf-4e87-990e-756b32557b1d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:39.990413 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-db61778b-a9cf-4e87-990e-756b32557b1d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2" status: 200 len: 1299 microversion: 2.1 time: 0.093395 Aug 17 08:47:39.990989 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 425/838] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:39 2022] GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2 => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:47:41.011016 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0d32c50c-561c-4f82-8914-47a6c48b7b71 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:41.011775 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0d32c50c-561c-4f82-8914-47a6c48b7b71 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 72836909-95a3-4172-adcb-33fd1456a1f2] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:41.014156 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:47:41.019427 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0d32c50c-561c-4f82-8914-47a6c48b7b71 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:41.019947 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0d32c50c-561c-4f82-8914-47a6c48b7b71 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:41.020377 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0d32c50c-561c-4f82-8914-47a6c48b7b71 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:41.021280 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0d32c50c-561c-4f82-8914-47a6c48b7b71 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:41.021733 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0d32c50c-561c-4f82-8914-47a6c48b7b71 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:41.022156 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0d32c50c-561c-4f82-8914-47a6c48b7b71 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:41.190321 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-8540af10-c9a6-492b-9ee9-ba9101966be7 req-deb6cba2-fdc1-4445-8a77-4ec7a67d1393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72836909-95a3-4172-adcb-33fd1456a1f2", "tag": "ead17ae3-59ab-46bd-b875-4892f71bccf0"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:47:41.200482 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-8540af10-c9a6-492b-9ee9-ba9101966be7 req-deb6cba2-fdc1-4445-8a77-4ec7a67d1393 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:41.200979 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-8540af10-c9a6-492b-9ee9-ba9101966be7 req-deb6cba2-fdc1-4445-8a77-4ec7a67d1393 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:41.201393 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-8540af10-c9a6-492b-9ee9-ba9101966be7 req-deb6cba2-fdc1-4445-8a77-4ec7a67d1393 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:41.213561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-8540af10-c9a6-492b-9ee9-ba9101966be7 req-deb6cba2-fdc1-4445-8a77-4ec7a67d1393 service nova] Creating event network-changed:ead17ae3-59ab-46bd-b875-4892f71bccf0 for instance 72836909-95a3-4172-adcb-33fd1456a1f2 on hv-cinder-85331 Aug 17 08:47:41.218506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-8540af10-c9a6-492b-9ee9-ba9101966be7 req-deb6cba2-fdc1-4445-8a77-4ec7a67d1393 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031992 Aug 17 08:47:41.219118 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 426/839] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:47:41.237933 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0d32c50c-561c-4f82-8914-47a6c48b7b71 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:41.246369 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0d32c50c-561c-4f82-8914-47a6c48b7b71 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2" status: 200 len: 1367 microversion: 2.1 time: 0.239401 Aug 17 08:47:41.246938 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 414/840] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:41 2022] GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:47:42.267776 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3e13702b-48e8-47f3-8de5-e4e12d129f3c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:42.268499 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3e13702b-48e8-47f3-8de5-e4e12d129f3c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 72836909-95a3-4172-adcb-33fd1456a1f2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:42.275256 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e13702b-48e8-47f3-8de5-e4e12d129f3c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:42.275763 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e13702b-48e8-47f3-8de5-e4e12d129f3c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:42.276199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e13702b-48e8-47f3-8de5-e4e12d129f3c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:42.276877 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e13702b-48e8-47f3-8de5-e4e12d129f3c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:42.277326 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e13702b-48e8-47f3-8de5-e4e12d129f3c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:42.277751 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3e13702b-48e8-47f3-8de5-e4e12d129f3c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:42.467766 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3e13702b-48e8-47f3-8de5-e4e12d129f3c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:42.475446 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3e13702b-48e8-47f3-8de5-e4e12d129f3c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2" status: 200 len: 1367 microversion: 2.1 time: 0.212319 Aug 17 08:47:42.476045 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 427/841] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:42 2022] GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:47:43.495847 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-4747937d-c16d-4e73-9650-1e9e8478cb66 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:43.496448 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-4747937d-c16d-4e73-9650-1e9e8478cb66 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 72836909-95a3-4172-adcb-33fd1456a1f2] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:43.502816 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4747937d-c16d-4e73-9650-1e9e8478cb66 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:43.503290 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4747937d-c16d-4e73-9650-1e9e8478cb66 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:43.503748 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4747937d-c16d-4e73-9650-1e9e8478cb66 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:43.504415 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4747937d-c16d-4e73-9650-1e9e8478cb66 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:43.504857 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4747937d-c16d-4e73-9650-1e9e8478cb66 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:43.505265 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4747937d-c16d-4e73-9650-1e9e8478cb66 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:43.631533 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-4747937d-c16d-4e73-9650-1e9e8478cb66 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:43.639006 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-4747937d-c16d-4e73-9650-1e9e8478cb66 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2" status: 200 len: 1367 microversion: 2.1 time: 0.146971 Aug 17 08:47:43.639580 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 415/842] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:43 2022] GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:47:44.659092 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-bcc1edf8-3c4f-47b5-9df2-6765fa5e2725 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:44.659737 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-bcc1edf8-3c4f-47b5-9df2-6765fa5e2725 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 72836909-95a3-4172-adcb-33fd1456a1f2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:44.666646 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcc1edf8-3c4f-47b5-9df2-6765fa5e2725 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:44.667128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcc1edf8-3c4f-47b5-9df2-6765fa5e2725 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:44.667586 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcc1edf8-3c4f-47b5-9df2-6765fa5e2725 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:44.668277 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcc1edf8-3c4f-47b5-9df2-6765fa5e2725 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:44.668729 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcc1edf8-3c4f-47b5-9df2-6765fa5e2725 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:44.669153 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcc1edf8-3c4f-47b5-9df2-6765fa5e2725 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:44.795239 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-bcc1edf8-3c4f-47b5-9df2-6765fa5e2725 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:44.802599 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-bcc1edf8-3c4f-47b5-9df2-6765fa5e2725 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2" status: 200 len: 1367 microversion: 2.1 time: 0.147421 Aug 17 08:47:44.803171 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 428/843] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:44 2022] GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:47:44.903042 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-201328c4-6533-4f18-a140-2592631b2522 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:44.903610 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-201328c4-6533-4f18-a140-2592631b2522 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:44.910018 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-201328c4-6533-4f18-a140-2592631b2522 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:44.910497 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-201328c4-6533-4f18-a140-2592631b2522 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:44.911151 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-201328c4-6533-4f18-a140-2592631b2522 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:44.911875 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-201328c4-6533-4f18-a140-2592631b2522 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:44.912326 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-201328c4-6533-4f18-a140-2592631b2522 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:44.912745 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-201328c4-6533-4f18-a140-2592631b2522 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:44.939409 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-201328c4-6533-4f18-a140-2592631b2522 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 08:47:45.010658 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-201328c4-6533-4f18-a140-2592631b2522 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa" status: 204 len: 0 microversion: 2.1 time: 0.111232 Aug 17 08:47:45.011235 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 416/844] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:47:44 2022] DELETE /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 08:47:45.020212 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-57b9bfd3-ce8b-44bd-9663-88c2f05c7140 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:45.020835 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-57b9bfd3-ce8b-44bd-9663-88c2f05c7140 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:45.027172 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-57b9bfd3-ce8b-44bd-9663-88c2f05c7140 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:45.027681 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-57b9bfd3-ce8b-44bd-9663-88c2f05c7140 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:45.028112 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-57b9bfd3-ce8b-44bd-9663-88c2f05c7140 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:45.028795 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-57b9bfd3-ce8b-44bd-9663-88c2f05c7140 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:45.029238 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-57b9bfd3-ce8b-44bd-9663-88c2f05c7140 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:45.029653 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-57b9bfd3-ce8b-44bd-9663-88c2f05c7140 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:45.161419 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-57b9bfd3-ce8b-44bd-9663-88c2f05c7140 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:45.169595 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-57b9bfd3-ce8b-44bd-9663-88c2f05c7140 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa" status: 200 len: 1576 microversion: 2.1 time: 0.154048 Aug 17 08:47:45.170165 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 429/845] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:45 2022] GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:47:45.824064 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-57089959-4ecd-4b4a-8d99-2fafdbed0068 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:45.824672 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-57089959-4ecd-4b4a-8d99-2fafdbed0068 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 72836909-95a3-4172-adcb-33fd1456a1f2] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:45.830490 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-57089959-4ecd-4b4a-8d99-2fafdbed0068 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:45.830958 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-57089959-4ecd-4b4a-8d99-2fafdbed0068 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:45.831380 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-57089959-4ecd-4b4a-8d99-2fafdbed0068 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:45.832071 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-57089959-4ecd-4b4a-8d99-2fafdbed0068 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:45.832511 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-57089959-4ecd-4b4a-8d99-2fafdbed0068 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:45.832920 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-57089959-4ecd-4b4a-8d99-2fafdbed0068 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:46.025496 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-57089959-4ecd-4b4a-8d99-2fafdbed0068 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:46.032956 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-57089959-4ecd-4b4a-8d99-2fafdbed0068 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2" status: 200 len: 1367 microversion: 2.1 time: 0.213391 Aug 17 08:47:46.033516 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 417/846] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:45 2022] GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:47:46.189434 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4a63a026-ddc1-4ab9-bc16-f66acdd7f38b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:46.190035 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-4a63a026-ddc1-4ab9-bc16-f66acdd7f38b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:46.197149 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4a63a026-ddc1-4ab9-bc16-f66acdd7f38b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:46.197689 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4a63a026-ddc1-4ab9-bc16-f66acdd7f38b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:46.198123 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4a63a026-ddc1-4ab9-bc16-f66acdd7f38b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:46.199073 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4a63a026-ddc1-4ab9-bc16-f66acdd7f38b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:46.199525 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4a63a026-ddc1-4ab9-bc16-f66acdd7f38b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:46.199969 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4a63a026-ddc1-4ab9-bc16-f66acdd7f38b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:46.331299 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-4a63a026-ddc1-4ab9-bc16-f66acdd7f38b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:46.339393 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4a63a026-ddc1-4ab9-bc16-f66acdd7f38b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa" status: 200 len: 1576 microversion: 2.1 time: 0.153777 Aug 17 08:47:46.339979 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 430/847] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:46 2022] GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:47:46.502563 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-d1a5aec5-ed4c-43a3-a4f6-f7483235e213 req-5fa67ad2-9cf2-4386-b5e1-b402824e1d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72836909-95a3-4172-adcb-33fd1456a1f2", "name": "network-vif-plugged", "status": "completed", "tag": "ead17ae3-59ab-46bd-b875-4892f71bccf0"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:47:46.512547 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-d1a5aec5-ed4c-43a3-a4f6-f7483235e213 req-5fa67ad2-9cf2-4386-b5e1-b402824e1d6c service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:46.513099 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-d1a5aec5-ed4c-43a3-a4f6-f7483235e213 req-5fa67ad2-9cf2-4386-b5e1-b402824e1d6c service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:46.513502 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-d1a5aec5-ed4c-43a3-a4f6-f7483235e213 req-5fa67ad2-9cf2-4386-b5e1-b402824e1d6c service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:46.524458 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-d1a5aec5-ed4c-43a3-a4f6-f7483235e213 req-5fa67ad2-9cf2-4386-b5e1-b402824e1d6c service nova] Creating event network-vif-plugged:ead17ae3-59ab-46bd-b875-4892f71bccf0 for instance 72836909-95a3-4172-adcb-33fd1456a1f2 on hv-cinder-85331 Aug 17 08:47:46.529052 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-d1a5aec5-ed4c-43a3-a4f6-f7483235e213 req-5fa67ad2-9cf2-4386-b5e1-b402824e1d6c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030179 Aug 17 08:47:46.529623 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 418/848] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:47:47.053057 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8fbf825f-d64d-4d91-bc24-96905037d48c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:47.053714 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8fbf825f-d64d-4d91-bc24-96905037d48c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 72836909-95a3-4172-adcb-33fd1456a1f2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:47.060810 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8fbf825f-d64d-4d91-bc24-96905037d48c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:47.061291 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8fbf825f-d64d-4d91-bc24-96905037d48c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:47.061726 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8fbf825f-d64d-4d91-bc24-96905037d48c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:47.062405 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8fbf825f-d64d-4d91-bc24-96905037d48c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:47.062853 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8fbf825f-d64d-4d91-bc24-96905037d48c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:47.063271 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8fbf825f-d64d-4d91-bc24-96905037d48c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:47.342056 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8fbf825f-d64d-4d91-bc24-96905037d48c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:47.349451 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8fbf825f-d64d-4d91-bc24-96905037d48c tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2" status: 200 len: 1367 microversion: 2.1 time: 0.300222 Aug 17 08:47:47.350021 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 431/849] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:47 2022] GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2 => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:47:47.360632 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-670ab1ff-ac51-4e44-86bf-250469ed98db tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:47.362123 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-670ab1ff-ac51-4e44-86bf-250469ed98db tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:47.369790 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-670ab1ff-ac51-4e44-86bf-250469ed98db tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:47.370395 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-670ab1ff-ac51-4e44-86bf-250469ed98db tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:47.370950 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-670ab1ff-ac51-4e44-86bf-250469ed98db tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:47.372047 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-670ab1ff-ac51-4e44-86bf-250469ed98db tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:47.372497 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-670ab1ff-ac51-4e44-86bf-250469ed98db tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:47.373094 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-670ab1ff-ac51-4e44-86bf-250469ed98db tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:47.617185 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-670ab1ff-ac51-4e44-86bf-250469ed98db tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:47.625126 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-670ab1ff-ac51-4e44-86bf-250469ed98db tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa" status: 200 len: 1576 microversion: 2.1 time: 0.268755 Aug 17 08:47:47.625680 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 419/850] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:47 2022] GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa => generated 1576 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:47:47.797453 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-c16a1079-6b10-4998-91b4-a5ee29ea6c88 req-7c4b9203-2236-4f03-be3c-cef7f089b433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7121f229-54ff-4621-a114-ae43449afcaa", "name": "network-vif-deleted", "tag": "68dd16d1-6450-4d16-9965-73c35488b738"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:47:47.807925 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-c16a1079-6b10-4998-91b4-a5ee29ea6c88 req-7c4b9203-2236-4f03-be3c-cef7f089b433 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:47.808489 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-c16a1079-6b10-4998-91b4-a5ee29ea6c88 req-7c4b9203-2236-4f03-be3c-cef7f089b433 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:47.808996 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-c16a1079-6b10-4998-91b4-a5ee29ea6c88 req-7c4b9203-2236-4f03-be3c-cef7f089b433 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:47.830582 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-c16a1079-6b10-4998-91b4-a5ee29ea6c88 req-7c4b9203-2236-4f03-be3c-cef7f089b433 service nova] Creating event network-vif-deleted:68dd16d1-6450-4d16-9965-73c35488b738 for instance 7121f229-54ff-4621-a114-ae43449afcaa on hv-cinder-85331 Aug 17 08:47:47.836110 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-c16a1079-6b10-4998-91b4-a5ee29ea6c88 req-7c4b9203-2236-4f03-be3c-cef7f089b433 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042260 Aug 17 08:47:47.836802 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 432/851] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:47:48.370878 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c66b1be5-b669-473d-b2c3-95b609cf67b2 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:48.371535 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c66b1be5-b669-473d-b2c3-95b609cf67b2 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 72836909-95a3-4172-adcb-33fd1456a1f2] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:48.377932 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c66b1be5-b669-473d-b2c3-95b609cf67b2 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:48.378480 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c66b1be5-b669-473d-b2c3-95b609cf67b2 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:48.378912 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c66b1be5-b669-473d-b2c3-95b609cf67b2 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:48.379609 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c66b1be5-b669-473d-b2c3-95b609cf67b2 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:48.380060 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c66b1be5-b669-473d-b2c3-95b609cf67b2 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:48.380474 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c66b1be5-b669-473d-b2c3-95b609cf67b2 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:48.516815 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c66b1be5-b669-473d-b2c3-95b609cf67b2 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:48.526381 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c66b1be5-b669-473d-b2c3-95b609cf67b2 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2" status: 200 len: 1557 microversion: 2.1 time: 0.159406 Aug 17 08:47:48.527212 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 420/852] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:48 2022] GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2 => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:47:48.548694 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-9b60737b-a26d-4363-9d5a-f11de5232d65 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:48.549859 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-9b60737b-a26d-4363-9d5a-f11de5232d65 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 72836909-95a3-4172-adcb-33fd1456a1f2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:48.558335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9b60737b-a26d-4363-9d5a-f11de5232d65 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:48.559078 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9b60737b-a26d-4363-9d5a-f11de5232d65 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:48.560766 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9b60737b-a26d-4363-9d5a-f11de5232d65 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:48.561899 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9b60737b-a26d-4363-9d5a-f11de5232d65 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:48.562562 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9b60737b-a26d-4363-9d5a-f11de5232d65 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:48.563215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9b60737b-a26d-4363-9d5a-f11de5232d65 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:48.647553 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8b422d47-6432-4e62-93ff-1c2826770033 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:48.648398 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8b422d47-6432-4e62-93ff-1c2826770033 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:48.655764 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8b422d47-6432-4e62-93ff-1c2826770033 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:48.656359 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8b422d47-6432-4e62-93ff-1c2826770033 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:48.656892 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8b422d47-6432-4e62-93ff-1c2826770033 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:48.657713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8b422d47-6432-4e62-93ff-1c2826770033 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:48.658998 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8b422d47-6432-4e62-93ff-1c2826770033 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:48.659489 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8b422d47-6432-4e62-93ff-1c2826770033 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:48.682661 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-9b60737b-a26d-4363-9d5a-f11de5232d65 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.138090 Aug 17 08:47:48.683255 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 433/853] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 17 08:47:48 2022] GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:47:48.700156 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8b422d47-6432-4e62-93ff-1c2826770033 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:48.700641 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8b422d47-6432-4e62-93ff-1c2826770033 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:48.701062 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8b422d47-6432-4e62-93ff-1c2826770033 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:48.701501 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-8b422d47-6432-4e62-93ff-1c2826770033 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lazy-loading 'fault' on Instance uuid 7121f229-54ff-4621-a114-ae43449afcaa {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:47:48.806985 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8b422d47-6432-4e62-93ff-1c2826770033 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:48.816528 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8b422d47-6432-4e62-93ff-1c2826770033 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa" status: 200 len: 1229 microversion: 2.1 time: 0.172682 Aug 17 08:47:48.817442 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 421/854] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:48 2022] GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa => generated 1229 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:47:49.836701 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:47:49.838569 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=6 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:47:49.843062 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f0472d60-a21b-43fc-817c-91f374e450d8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:49.843690 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-f0472d60-a21b-43fc-817c-91f374e450d8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:49.850389 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f0472d60-a21b-43fc-817c-91f374e450d8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:49.850880 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f0472d60-a21b-43fc-817c-91f374e450d8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:49.851288 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f0472d60-a21b-43fc-817c-91f374e450d8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:49.852001 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f0472d60-a21b-43fc-817c-91f374e450d8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:49.852447 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f0472d60-a21b-43fc-817c-91f374e450d8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:49.852862 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-f0472d60-a21b-43fc-817c-91f374e450d8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:49.865787 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-f0472d60-a21b-43fc-817c-91f374e450d8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] HTTP exception thrown: Instance 7121f229-54ff-4621-a114-ae43449afcaa could not be found. Aug 17 08:47:49.867397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f0472d60-a21b-43fc-817c-91f374e450d8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Request method failure captured: Aug 17 08:47:49.867397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa HTTP/1.1 Aug 17 08:47:49.867397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:47:49.867397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:47:49.867397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:47:49.867397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:47:49.867397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:47:49.867397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:47:49.867397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:47:49.867397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:47:49.867397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_KqTOZHHp4exlO9JtJvsxhU-XYqXYc5SttvczNE_w4p59bh8OCi-5xACSgv1RbctOsIDt0kRSJzjpMlFSNXzpcJeMw2-2JfJKowdfVi05mnPbRPopenh1uAbG4FQG04MtNjR4cEOuEtLzb5kdwyG7jCh6ueGti39sT6TwiusrQr38WM Aug 17 08:47:49.867397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:47:49.867397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:47:49.867397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:47:49.867397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:47:49.867397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:47:49.867397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:47:49.867397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: e2604417eb5f48f0b026b00a9c164e08 Aug 17 08:47:49.867397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-TestVolumeBootPattern-1304915916 Aug 17 08:47:49.867397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:47:49.867397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:47:49.869112 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e2604417eb5f48f0b026b00a9c164e08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e2604417eb5f48f0b026b00a9c164e08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e2604417eb5f48f0b026b00a9c164e08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e2604417eb5f48f0b026b00a9c164e08", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:47:49.869112 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-TestVolumeBootPattern-1304915916 Aug 17 08:47:49.869112 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: e2604417eb5f48f0b026b00a9c164e08 Aug 17 08:47:49.869112 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-TestVolumeBootPattern-1304915916 Aug 17 08:47:49.869112 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-TestVolumeBootPattern-1304915916-project Aug 17 08:47:49.869112 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:47:49.869112 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:47:49.869112 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: 73a4f1987dda43068520217d36d99799 Aug 17 08:47:49.869112 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-TestVolumeBootPattern-1304915916-project Aug 17 08:47:49.869112 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: > Aug 17 08:47:49.869112 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Instance 7121f229-54ff-4621-a114-ae43449afcaa could not be found. Aug 17 08:47:49.869112 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': '7121f229-54ff-4621-a114-ae43449afcaa'} Aug 17 08:47:49.870107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:47:49.870107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:47:49.870107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:47:49.870107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:47:49.870107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:47:49.870107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:47:49.870107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:47:49.870107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:47:49.870107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:47:49.870107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:47:49.870107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7121f229-54ff-4621-a114-ae43449afcaa could not be found. Aug 17 08:47:49.870107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:47:49.870107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:47:49.870107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:47:49.870107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:47:49.870107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:47:49.870107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:47:49.870107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:47:49.870107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:47:49.870107 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:47:49.871698 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:47:49.871698 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:47:49.871698 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:47:49.871698 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:47:49.871698 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:47:49.871698 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:47:49.871698 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:47:49.871698 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7121f229-54ff-4621-a114-ae43449afcaa could not be found. Aug 17 08:47:49.871698 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:47:49.871698 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:47:49.871698 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:47:49.871698 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:47:49.871698 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:47:49.871698 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:47:49.871698 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:47:49.871698 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:47:49.871698 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7121f229-54ff-4621-a114-ae43449afcaa could not be found. Aug 17 08:47:49.871698 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:47:49.873083 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-f0472d60-a21b-43fc-817c-91f374e450d8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Returning 404 to user: Instance 7121f229-54ff-4621-a114-ae43449afcaa could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:47:49.873083 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-f0472d60-a21b-43fc-817c-91f374e450d8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa" status: 404 len: 111 microversion: 2.1 time: 0.033043 Aug 17 08:47:49.873083 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 434/855] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:49 2022] GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:47:49.922271 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-70c2cc84-c138-4c50-99df-15ea0a9a23bd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1033062572", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-450789034", "security_groups": [{"name": "tempest-secgroup-smoke-604269867"}], "block_device_mapping_v2": [{"uuid": "1342018d-bc3f-4eb8-aefd-39f17a969404", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2cc8fb46-3628-4864-93c3-c9178d343e2b"}]}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:47:49.936852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=6 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:47:49.951344 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-e1c62f47-b7bb-49f5-91e5-41dfd6d33398 req-7a4387ab-7d72-4ad4-82d3-0ff3328f694e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72836909-95a3-4172-adcb-33fd1456a1f2", "tag": "ead17ae3-59ab-46bd-b875-4892f71bccf0"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:47:49.960529 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-e1c62f47-b7bb-49f5-91e5-41dfd6d33398 req-7a4387ab-7d72-4ad4-82d3-0ff3328f694e service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:49.961315 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-e1c62f47-b7bb-49f5-91e5-41dfd6d33398 req-7a4387ab-7d72-4ad4-82d3-0ff3328f694e service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:49.961833 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-e1c62f47-b7bb-49f5-91e5-41dfd6d33398 req-7a4387ab-7d72-4ad4-82d3-0ff3328f694e service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:49.985743 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-e1c62f47-b7bb-49f5-91e5-41dfd6d33398 req-7a4387ab-7d72-4ad4-82d3-0ff3328f694e service nova] Creating event network-changed:ead17ae3-59ab-46bd-b875-4892f71bccf0 for instance 72836909-95a3-4172-adcb-33fd1456a1f2 on hv-cinder-85331 Aug 17 08:47:49.990529 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-e1c62f47-b7bb-49f5-91e5-41dfd6d33398 req-7a4387ab-7d72-4ad4-82d3-0ff3328f694e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043849 Aug 17 08:47:49.991195 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 435/856] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:47:50.063103 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.network.neutron [None req-70c2cc84-c138-4c50-99df-15ea0a9a23bd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] validate_networks() for [('2cc8fb46-3628-4864-93c3-c9178d343e2b', None, None, None, None, None)] {{(pid=127298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 08:47:50.716260 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-70c2cc84-c138-4c50-99df-15ea0a9a23bd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Flavor limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 08:47:50.716767 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-70c2cc84-c138-4c50-99df-15ea0a9a23bd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Image limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 08:47:50.717345 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-70c2cc84-c138-4c50-99df-15ea0a9a23bd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Flavor pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 08:47:50.718067 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-70c2cc84-c138-4c50-99df-15ea0a9a23bd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Image pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 08:47:50.718580 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-70c2cc84-c138-4c50-99df-15ea0a9a23bd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 08:47:50.727973 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-70c2cc84-c138-4c50-99df-15ea0a9a23bd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:50.728738 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-70c2cc84-c138-4c50-99df-15ea0a9a23bd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:50.729506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-70c2cc84-c138-4c50-99df-15ea0a9a23bd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:50.730447 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-70c2cc84-c138-4c50-99df-15ea0a9a23bd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:50.730981 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-70c2cc84-c138-4c50-99df-15ea0a9a23bd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:50.731454 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-70c2cc84-c138-4c50-99df-15ea0a9a23bd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:50.749040 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-70c2cc84-c138-4c50-99df-15ea0a9a23bd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Getting quotas for project e2604417eb5f48f0b026b00a9c164e08. Resources: {'cores', 'instances', 'ram'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:47:50.753093 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-70c2cc84-c138-4c50-99df-15ea0a9a23bd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Getting quotas for user 73a4f1987dda43068520217d36d99799 and project e2604417eb5f48f0b026b00a9c164e08. Resources: {'cores', 'instances', 'ram'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:47:50.815263 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-70c2cc84-c138-4c50-99df-15ea0a9a23bd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Going to run 1 instances... {{(pid=127298) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 08:47:50.817366 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-70c2cc84-c138-4c50-99df-15ea0a9a23bd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 722b88a8-8b51-445c-905e-8184f2411d12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1342018d-bc3f-4eb8-aefd-39f17a969404',volume_size=None,volume_type=None)] {{(pid=127298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 08:47:50.953583 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-70c2cc84-c138-4c50-99df-15ea0a9a23bd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.035061 Aug 17 08:47:50.955678 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 422/857] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 08:47:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 08:47:50.966503 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-214d994f-3ce7-4512-b22e-7c0d1dd43d5b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:50.967776 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-214d994f-3ce7-4512-b22e-7c0d1dd43d5b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 722b88a8-8b51-445c-905e-8184f2411d12] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:51.023456 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-214d994f-3ce7-4512-b22e-7c0d1dd43d5b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:51.030423 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-214d994f-3ce7-4512-b22e-7c0d1dd43d5b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12" status: 200 len: 1094 microversion: 2.1 time: 0.067919 Aug 17 08:47:51.030990 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 436/858] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:50 2022] GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:47:52.051042 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-09b51262-eec2-444c-8436-7bb565792ef6 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:52.051767 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-09b51262-eec2-444c-8436-7bb565792ef6 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 722b88a8-8b51-445c-905e-8184f2411d12] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:52.058960 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-09b51262-eec2-444c-8436-7bb565792ef6 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:52.059561 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-09b51262-eec2-444c-8436-7bb565792ef6 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:52.060203 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-09b51262-eec2-444c-8436-7bb565792ef6 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:52.060892 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-09b51262-eec2-444c-8436-7bb565792ef6 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:52.061851 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-09b51262-eec2-444c-8436-7bb565792ef6 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:52.062288 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-09b51262-eec2-444c-8436-7bb565792ef6 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:52.134643 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-09b51262-eec2-444c-8436-7bb565792ef6 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:52.142194 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-09b51262-eec2-444c-8436-7bb565792ef6 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12" status: 200 len: 1210 microversion: 2.1 time: 0.095147 Aug 17 08:47:52.142934 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 423/859] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:52 2022] GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12 => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:47:53.162162 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d42ee731-f1ec-4cad-9d97-01c6c7b3c7a1 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:53.162960 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d42ee731-f1ec-4cad-9d97-01c6c7b3c7a1 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 722b88a8-8b51-445c-905e-8184f2411d12] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:53.170426 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d42ee731-f1ec-4cad-9d97-01c6c7b3c7a1 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:53.170986 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d42ee731-f1ec-4cad-9d97-01c6c7b3c7a1 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:53.171511 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d42ee731-f1ec-4cad-9d97-01c6c7b3c7a1 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:53.172283 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d42ee731-f1ec-4cad-9d97-01c6c7b3c7a1 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:53.172736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d42ee731-f1ec-4cad-9d97-01c6c7b3c7a1 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:53.173287 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d42ee731-f1ec-4cad-9d97-01c6c7b3c7a1 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:53.306979 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d42ee731-f1ec-4cad-9d97-01c6c7b3c7a1 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:53.311932 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-b02955f5-2ee1-4241-8b69-3a7c1c931e7b req-7daa9252-7d4b-4812-bdd5-6be8bfc7d555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "722b88a8-8b51-445c-905e-8184f2411d12", "tag": "9fc7feb5-24f5-44ed-95e0-b35c8999de23"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:47:53.321037 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d42ee731-f1ec-4cad-9d97-01c6c7b3c7a1 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12" status: 200 len: 1265 microversion: 2.1 time: 0.162521 Aug 17 08:47:53.324860 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-b02955f5-2ee1-4241-8b69-3a7c1c931e7b req-7daa9252-7d4b-4812-bdd5-6be8bfc7d555 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:53.325430 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-b02955f5-2ee1-4241-8b69-3a7c1c931e7b req-7daa9252-7d4b-4812-bdd5-6be8bfc7d555 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:53.325857 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-b02955f5-2ee1-4241-8b69-3a7c1c931e7b req-7daa9252-7d4b-4812-bdd5-6be8bfc7d555 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:53.332240 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 437/860] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:53 2022] GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:47:53.339247 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-b02955f5-2ee1-4241-8b69-3a7c1c931e7b req-7daa9252-7d4b-4812-bdd5-6be8bfc7d555 service nova] Creating event network-changed:9fc7feb5-24f5-44ed-95e0-b35c8999de23 for instance 722b88a8-8b51-445c-905e-8184f2411d12 on hv-cinder-85331 Aug 17 08:47:53.344409 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-b02955f5-2ee1-4241-8b69-3a7c1c931e7b req-7daa9252-7d4b-4812-bdd5-6be8bfc7d555 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036329 Aug 17 08:47:53.344992 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 424/861] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:47:54.342248 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d4c2840e-946a-4778-81cb-5a48d96598df tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:54.342987 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d4c2840e-946a-4778-81cb-5a48d96598df tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 722b88a8-8b51-445c-905e-8184f2411d12] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:54.349545 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d4c2840e-946a-4778-81cb-5a48d96598df tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:54.350046 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d4c2840e-946a-4778-81cb-5a48d96598df tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:54.350476 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d4c2840e-946a-4778-81cb-5a48d96598df tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:54.351218 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d4c2840e-946a-4778-81cb-5a48d96598df tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:54.351691 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d4c2840e-946a-4778-81cb-5a48d96598df tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:54.352652 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d4c2840e-946a-4778-81cb-5a48d96598df tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:54.486696 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-d4c2840e-946a-4778-81cb-5a48d96598df tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:54.494874 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d4c2840e-946a-4778-81cb-5a48d96598df tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12" status: 200 len: 1265 microversion: 2.1 time: 0.156516 Aug 17 08:47:54.495444 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 438/862] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:54 2022] GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:47:55.516095 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-00ca2f31-1d03-4599-9f62-ac225759194b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:55.516723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-00ca2f31-1d03-4599-9f62-ac225759194b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 722b88a8-8b51-445c-905e-8184f2411d12] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:55.523684 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-00ca2f31-1d03-4599-9f62-ac225759194b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:55.524152 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-00ca2f31-1d03-4599-9f62-ac225759194b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:55.524575 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-00ca2f31-1d03-4599-9f62-ac225759194b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:55.525242 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-00ca2f31-1d03-4599-9f62-ac225759194b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:55.525682 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-00ca2f31-1d03-4599-9f62-ac225759194b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:55.526094 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-00ca2f31-1d03-4599-9f62-ac225759194b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:55.654097 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-00ca2f31-1d03-4599-9f62-ac225759194b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:55.661597 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-00ca2f31-1d03-4599-9f62-ac225759194b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12" status: 200 len: 1265 microversion: 2.1 time: 0.149816 Aug 17 08:47:55.662152 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 425/863] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:55 2022] GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:47:56.681614 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a2a2793e-8b0a-472a-8061-ebc68cbb3197 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:56.682226 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a2a2793e-8b0a-472a-8061-ebc68cbb3197 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 722b88a8-8b51-445c-905e-8184f2411d12] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:56.688736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a2a2793e-8b0a-472a-8061-ebc68cbb3197 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:56.689220 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a2a2793e-8b0a-472a-8061-ebc68cbb3197 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:56.689666 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a2a2793e-8b0a-472a-8061-ebc68cbb3197 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:56.690360 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a2a2793e-8b0a-472a-8061-ebc68cbb3197 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:56.692151 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a2a2793e-8b0a-472a-8061-ebc68cbb3197 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:56.692151 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a2a2793e-8b0a-472a-8061-ebc68cbb3197 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:56.736768 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1df15485-f0ce-425f-9105-63fb5c3cf143 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:56.738918 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1df15485-f0ce-425f-9105-63fb5c3cf143 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:56.745269 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1df15485-f0ce-425f-9105-63fb5c3cf143 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:56.745750 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1df15485-f0ce-425f-9105-63fb5c3cf143 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:56.746185 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1df15485-f0ce-425f-9105-63fb5c3cf143 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:56.746875 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1df15485-f0ce-425f-9105-63fb5c3cf143 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:56.747335 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1df15485-f0ce-425f-9105-63fb5c3cf143 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:56.747787 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1df15485-f0ce-425f-9105-63fb5c3cf143 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:56.776821 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1df15485-f0ce-425f-9105-63fb5c3cf143 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043941 Aug 17 08:47:56.777587 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 426/864] 10.222.0.15 () {60 vars in 1343 bytes} [Wed Aug 17 08:47:56 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:47:56.824425 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a2a2793e-8b0a-472a-8061-ebc68cbb3197 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:56.832027 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a2a2793e-8b0a-472a-8061-ebc68cbb3197 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12" status: 200 len: 1265 microversion: 2.1 time: 0.154232 Aug 17 08:47:56.832662 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 439/865] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:56 2022] GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:47:56.838600 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3cdc6929-bf2e-4507-b8d8-ff2d56cbd0e8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:56.839083 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3cdc6929-bf2e-4507-b8d8-ff2d56cbd0e8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:56.845064 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3cdc6929-bf2e-4507-b8d8-ff2d56cbd0e8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:56.845481 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3cdc6929-bf2e-4507-b8d8-ff2d56cbd0e8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:56.845908 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3cdc6929-bf2e-4507-b8d8-ff2d56cbd0e8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:56.846583 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3cdc6929-bf2e-4507-b8d8-ff2d56cbd0e8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:56.847029 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3cdc6929-bf2e-4507-b8d8-ff2d56cbd0e8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:56.847445 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3cdc6929-bf2e-4507-b8d8-ff2d56cbd0e8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:56.871431 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3cdc6929-bf2e-4507-b8d8-ff2d56cbd0e8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 08:47:56.907412 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:47:56.951503 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3cdc6929-bf2e-4507-b8d8-ff2d56cbd0e8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 204 len: 0 microversion: 2.20 time: 0.117021 Aug 17 08:47:56.952606 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 427/866] 10.222.0.15 () {60 vars in 1280 bytes} [Wed Aug 17 08:47:56 2022] DELETE /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 08:47:56.960270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-aed78930-5aff-4691-bea3-7a760268b293 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:56.960876 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-aed78930-5aff-4691-bea3-7a760268b293 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:56.966877 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aed78930-5aff-4691-bea3-7a760268b293 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:56.967364 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aed78930-5aff-4691-bea3-7a760268b293 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:56.967843 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aed78930-5aff-4691-bea3-7a760268b293 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:56.968530 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aed78930-5aff-4691-bea3-7a760268b293 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:56.968981 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aed78930-5aff-4691-bea3-7a760268b293 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:56.969401 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-aed78930-5aff-4691-bea3-7a760268b293 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:57.099949 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-aed78930-5aff-4691-bea3-7a760268b293 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:57.107760 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-aed78930-5aff-4691-bea3-7a760268b293 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:57.109247 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-aed78930-5aff-4691-bea3-7a760268b293 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:57.110406 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-aed78930-5aff-4691-bea3-7a760268b293 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1725 microversion: 2.20 time: 0.154022 Aug 17 08:47:57.110950 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 440/867] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:47:56 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:47:57.853129 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c2e4309c-14ba-4959-b080-340ceaac2f9a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:57.853817 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c2e4309c-14ba-4959-b080-340ceaac2f9a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 722b88a8-8b51-445c-905e-8184f2411d12] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:57.860253 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c2e4309c-14ba-4959-b080-340ceaac2f9a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:57.860675 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c2e4309c-14ba-4959-b080-340ceaac2f9a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:57.861107 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c2e4309c-14ba-4959-b080-340ceaac2f9a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:57.861781 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c2e4309c-14ba-4959-b080-340ceaac2f9a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:57.862227 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c2e4309c-14ba-4959-b080-340ceaac2f9a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:57.862643 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c2e4309c-14ba-4959-b080-340ceaac2f9a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:57.994280 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-c2e4309c-14ba-4959-b080-340ceaac2f9a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:58.001709 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c2e4309c-14ba-4959-b080-340ceaac2f9a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12" status: 200 len: 1265 microversion: 2.1 time: 0.152936 Aug 17 08:47:58.002267 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 428/868] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:57 2022] GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:47:58.134246 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b4db8097-971f-41b2-a2b6-50d30eee131d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:58.134843 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b4db8097-971f-41b2-a2b6-50d30eee131d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:58.141431 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b4db8097-971f-41b2-a2b6-50d30eee131d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:58.141913 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b4db8097-971f-41b2-a2b6-50d30eee131d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:58.142345 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b4db8097-971f-41b2-a2b6-50d30eee131d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:58.143057 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b4db8097-971f-41b2-a2b6-50d30eee131d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:58.143532 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b4db8097-971f-41b2-a2b6-50d30eee131d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:58.143972 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b4db8097-971f-41b2-a2b6-50d30eee131d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:58.275525 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b4db8097-971f-41b2-a2b6-50d30eee131d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:58.283734 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b4db8097-971f-41b2-a2b6-50d30eee131d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:58.285232 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-b4db8097-971f-41b2-a2b6-50d30eee131d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:58.286380 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b4db8097-971f-41b2-a2b6-50d30eee131d tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1725 microversion: 2.20 time: 0.156149 Aug 17 08:47:58.286931 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 441/869] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:47:58 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 08:47:59.022379 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ffc7f84f-3c0a-423d-bb54-792f4e863bee tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:59.023044 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ffc7f84f-3c0a-423d-bb54-792f4e863bee tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 722b88a8-8b51-445c-905e-8184f2411d12] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:59.030623 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ffc7f84f-3c0a-423d-bb54-792f4e863bee tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:59.031104 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ffc7f84f-3c0a-423d-bb54-792f4e863bee tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:59.031557 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ffc7f84f-3c0a-423d-bb54-792f4e863bee tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:59.032254 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ffc7f84f-3c0a-423d-bb54-792f4e863bee tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:59.032725 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ffc7f84f-3c0a-423d-bb54-792f4e863bee tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:59.033179 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ffc7f84f-3c0a-423d-bb54-792f4e863bee tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:59.309205 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-27ef1bcb-49b5-48ab-9ea4-bfe2faf3fc8f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:47:59.309750 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-27ef1bcb-49b5-48ab-9ea4-bfe2faf3fc8f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:47:59.316585 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-27ef1bcb-49b5-48ab-9ea4-bfe2faf3fc8f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:59.317070 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-27ef1bcb-49b5-48ab-9ea4-bfe2faf3fc8f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:59.317503 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-27ef1bcb-49b5-48ab-9ea4-bfe2faf3fc8f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:59.318198 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-27ef1bcb-49b5-48ab-9ea4-bfe2faf3fc8f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:59.318650 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-27ef1bcb-49b5-48ab-9ea4-bfe2faf3fc8f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:59.319065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-27ef1bcb-49b5-48ab-9ea4-bfe2faf3fc8f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:59.382897 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-27ef1bcb-49b5-48ab-9ea4-bfe2faf3fc8f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:59.391346 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-27ef1bcb-49b5-48ab-9ea4-bfe2faf3fc8f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:59.392909 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-27ef1bcb-49b5-48ab-9ea4-bfe2faf3fc8f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd586af36267c475ab5af42a23ce3f1b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb857c94e3f6405baad84dfc45445b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:59.394071 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-27ef1bcb-49b5-48ab-9ea4-bfe2faf3fc8f tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 200 len: 1657 microversion: 2.20 time: 0.088915 Aug 17 08:47:59.394628 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 442/870] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:47:59 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 1657 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 08:47:59.513546 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ffc7f84f-3c0a-423d-bb54-792f4e863bee tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:47:59.521112 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ffc7f84f-3c0a-423d-bb54-792f4e863bee tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12" status: 200 len: 1265 microversion: 2.1 time: 0.502846 Aug 17 08:47:59.521760 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 429/871] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:47:59 2022] GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12 => generated 1265 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:47:59.724162 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-2657d89c-698c-400b-9cfd-d7482fd204a3 req-909d7237-33fe-43d2-8cae-37b2eda4fa95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f579cfbe-0b43-4710-8ba4-ba221a36e20b", "name": "network-vif-deleted", "tag": "fa872a89-5241-4d0c-9875-c10826245c65"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:47:59.734594 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-2657d89c-698c-400b-9cfd-d7482fd204a3 req-909d7237-33fe-43d2-8cae-37b2eda4fa95 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:47:59.734594 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-2657d89c-698c-400b-9cfd-d7482fd204a3 req-909d7237-33fe-43d2-8cae-37b2eda4fa95 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:47:59.735109 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-2657d89c-698c-400b-9cfd-d7482fd204a3 req-909d7237-33fe-43d2-8cae-37b2eda4fa95 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:47:59.746491 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-2657d89c-698c-400b-9cfd-d7482fd204a3 req-909d7237-33fe-43d2-8cae-37b2eda4fa95 service nova] Creating event network-vif-deleted:fa872a89-5241-4d0c-9875-c10826245c65 for instance f579cfbe-0b43-4710-8ba4-ba221a36e20b on hv-cinder-85331 Aug 17 08:47:59.751567 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-2657d89c-698c-400b-9cfd-d7482fd204a3 req-909d7237-33fe-43d2-8cae-37b2eda4fa95 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031491 Aug 17 08:47:59.752427 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 443/872] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:48:00.418368 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d4b41275-9744-44cb-9cd7-a72191d702df tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:00.419314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d4b41275-9744-44cb-9cd7-a72191d702df tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:00.425735 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4b41275-9744-44cb-9cd7-a72191d702df tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:00.426223 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4b41275-9744-44cb-9cd7-a72191d702df tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:00.426652 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4b41275-9744-44cb-9cd7-a72191d702df tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:00.427334 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4b41275-9744-44cb-9cd7-a72191d702df tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:00.427802 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4b41275-9744-44cb-9cd7-a72191d702df tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:00.428407 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d4b41275-9744-44cb-9cd7-a72191d702df tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:00.447934 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-d4b41275-9744-44cb-9cd7-a72191d702df tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] HTTP exception thrown: Instance f579cfbe-0b43-4710-8ba4-ba221a36e20b could not be found. Aug 17 08:48:00.450354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d4b41275-9744-44cb-9cd7-a72191d702df tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Request method failure captured: Aug 17 08:48:00.450354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b HTTP/1.1 Aug 17 08:48:00.450354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:48:00.450354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:48:00.450354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:48:00.450354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:48:00.450354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:48:00.450354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:48:00.450354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:48:00.450354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:48:00.450354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_KohAvYrj5W_Z2jwMlBluU7GmlTT6O13XSVTTrpCjQZCZ4ES-7SLbpYEtZZzleqAbqMnkPUGFxsUNXl7LcEs8lxDpkhyA4NBFQuijl1q1Ogx24ms9LWq0vojzRLUXurTqBPcgv66wuXR4dQy0vXjpDAnNUyS0L35h6loPA8VXRTK6PE Aug 17 08:48:00.450354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:48:00.450354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:48:00.450354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:48:00.450354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:48:00.450354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 08:48:00.450354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:48:00.450354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:48:00.450354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: eb857c94e3f6405baad84dfc45445b0d Aug 17 08:48:00.450354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-296675391 Aug 17 08:48:00.450354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:48:00.450354 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:48:00.452178 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb857c94e3f6405baad84dfc45445b0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/eb857c94e3f6405baad84dfc45445b0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb857c94e3f6405baad84dfc45445b0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_eb857c94e3f6405baad84dfc45445b0d", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:48:00.452178 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeShelveTestJSON-296675391 Aug 17 08:48:00.452178 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: eb857c94e3f6405baad84dfc45445b0d Aug 17 08:48:00.452178 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-296675391 Aug 17 08:48:00.452178 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeShelveTestJSON-296675391-project Aug 17 08:48:00.452178 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:48:00.452178 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:48:00.452178 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: d586af36267c475ab5af42a23ce3f1b1 Aug 17 08:48:00.452178 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeShelveTestJSON-296675391-project Aug 17 08:48:00.452178 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:48:00.452178 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Instance f579cfbe-0b43-4710-8ba4-ba221a36e20b could not be found. Aug 17 08:48:00.452178 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'id': 'f579cfbe-0b43-4710-8ba4-ba221a36e20b'} Aug 17 08:48:00.453160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:48:00.453160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:00.453160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:48:00.453160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:48:00.453160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:48:00.453160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:48:00.453160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:48:00.453160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:48:00.453160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:48:00.453160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:48:00.453160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f579cfbe-0b43-4710-8ba4-ba221a36e20b could not be found. Aug 17 08:48:00.453160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:00.453160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:00.453160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:00.453160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:00.453160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:00.453160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:00.453160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:48:00.453160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:48:00.453160 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:48:00.454751 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:48:00.454751 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:48:00.454751 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:48:00.454751 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:48:00.454751 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:48:00.454751 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:48:00.454751 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:48:00.454751 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f579cfbe-0b43-4710-8ba4-ba221a36e20b could not be found. Aug 17 08:48:00.454751 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:00.454751 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:00.454751 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:00.454751 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:00.454751 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:00.454751 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:00.454751 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:48:00.454751 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:48:00.454751 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f579cfbe-0b43-4710-8ba4-ba221a36e20b could not be found. Aug 17 08:48:00.454751 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:00.457769 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d4b41275-9744-44cb-9cd7-a72191d702df tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Returning 404 to user: Instance f579cfbe-0b43-4710-8ba4-ba221a36e20b could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:48:00.458802 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d4b41275-9744-44cb-9cd7-a72191d702df tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 404 len: 111 microversion: 2.20 time: 0.044937 Aug 17 08:48:00.464288 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 430/873] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:48:00 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 17 08:48:00.470381 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0d4838e5-a44b-4846-ab44-6574f6a6ec7a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '.version_select at 0x7f3f8612eb80>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:00.495865 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0d4838e5-a44b-4846-ab44-6574f6a6ec7a tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-504629478" status: 204 len: 0 microversion: 2.20 time: 0.030597 Aug 17 08:48:00.496613 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 444/874] 10.222.0.15 () {60 vars in 1259 bytes} [Wed Aug 17 08:48:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-504629478 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 17 08:48:00.542396 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-94da969e-08ee-436b-a4ab-464bb0c3c66b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:00.543311 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-94da969e-08ee-436b-a4ab-464bb0c3c66b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 722b88a8-8b51-445c-905e-8184f2411d12] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:00.549595 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-94da969e-08ee-436b-a4ab-464bb0c3c66b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:00.550315 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-94da969e-08ee-436b-a4ab-464bb0c3c66b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:00.550914 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-94da969e-08ee-436b-a4ab-464bb0c3c66b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:00.552058 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-94da969e-08ee-436b-a4ab-464bb0c3c66b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:00.552665 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-94da969e-08ee-436b-a4ab-464bb0c3c66b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:00.553238 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-94da969e-08ee-436b-a4ab-464bb0c3c66b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:00.740069 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:00.760628 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=6 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:00.792577 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-94da969e-08ee-436b-a4ab-464bb0c3c66b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:48:00.801990 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-94da969e-08ee-436b-a4ab-464bb0c3c66b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12" status: 200 len: 1265 microversion: 2.1 time: 0.263648 Aug 17 08:48:00.802693 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 431/875] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:48:00 2022] GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12 => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:48:01.821503 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:01.826426 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6c6cf7e8-c0e0-49e2-a3ca-d3aa28502d80 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:01.827115 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6c6cf7e8-c0e0-49e2-a3ca-d3aa28502d80 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 722b88a8-8b51-445c-905e-8184f2411d12] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:01.834304 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c6cf7e8-c0e0-49e2-a3ca-d3aa28502d80 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:01.834763 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c6cf7e8-c0e0-49e2-a3ca-d3aa28502d80 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:01.835191 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c6cf7e8-c0e0-49e2-a3ca-d3aa28502d80 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:01.835952 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c6cf7e8-c0e0-49e2-a3ca-d3aa28502d80 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:01.836957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c6cf7e8-c0e0-49e2-a3ca-d3aa28502d80 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:01.837377 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6c6cf7e8-c0e0-49e2-a3ca-d3aa28502d80 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:01.965635 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6c6cf7e8-c0e0-49e2-a3ca-d3aa28502d80 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:48:01.969012 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=100 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:01.974251 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6c6cf7e8-c0e0-49e2-a3ca-d3aa28502d80 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12" status: 200 len: 1265 microversion: 2.1 time: 0.154181 Aug 17 08:48:01.974821 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 445/876] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:48:01 2022] GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:48:02.298408 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-906ef240-0258-4ad0-9863-3f33134f7715 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:02.298907 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-906ef240-0258-4ad0-9863-3f33134f7715 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:02.305818 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-906ef240-0258-4ad0-9863-3f33134f7715 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:02.306292 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-906ef240-0258-4ad0-9863-3f33134f7715 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:02.306723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-906ef240-0258-4ad0-9863-3f33134f7715 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:02.307405 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-906ef240-0258-4ad0-9863-3f33134f7715 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:02.307888 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-906ef240-0258-4ad0-9863-3f33134f7715 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:02.308309 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-906ef240-0258-4ad0-9863-3f33134f7715 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:02.321831 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-906ef240-0258-4ad0-9863-3f33134f7715 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] HTTP exception thrown: Instance f579cfbe-0b43-4710-8ba4-ba221a36e20b could not be found. Aug 17 08:48:02.323614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-906ef240-0258-4ad0-9863-3f33134f7715 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Request method failure captured: Aug 17 08:48:02.323614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: DELETE /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b HTTP/1.1 Aug 17 08:48:02.323614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:48:02.323614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:48:02.323614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:48:02.323614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:48:02.323614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:48:02.323614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:48:02.323614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:48:02.323614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:48:02.323614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_KohAvYrj5W_Z2jwMlBluU7GmlTT6O13XSVTTrpCjQZCZ4ES-7SLbpYEtZZzleqAbqMnkPUGFxsUNXl7LcEs8lxDpkhyA4NBFQuijl1q1Ogx24ms9LWq0vojzRLUXurTqBPcgv66wuXR4dQy0vXjpDAnNUyS0L35h6loPA8VXRTK6PE Aug 17 08:48:02.323614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:48:02.323614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:48:02.323614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:48:02.323614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:48:02.323614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 08:48:02.323614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:48:02.323614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:48:02.323614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: eb857c94e3f6405baad84dfc45445b0d Aug 17 08:48:02.323614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-296675391 Aug 17 08:48:02.323614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:48:02.323614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:48:02.325128 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb857c94e3f6405baad84dfc45445b0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/eb857c94e3f6405baad84dfc45445b0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb857c94e3f6405baad84dfc45445b0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_eb857c94e3f6405baad84dfc45445b0d", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:48:02.325128 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeShelveTestJSON-296675391 Aug 17 08:48:02.325128 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: eb857c94e3f6405baad84dfc45445b0d Aug 17 08:48:02.325128 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-296675391 Aug 17 08:48:02.325128 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeShelveTestJSON-296675391-project Aug 17 08:48:02.325128 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:48:02.325128 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:48:02.325128 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: d586af36267c475ab5af42a23ce3f1b1 Aug 17 08:48:02.325128 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeShelveTestJSON-296675391-project Aug 17 08:48:02.325128 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:48:02.325128 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Instance f579cfbe-0b43-4710-8ba4-ba221a36e20b could not be found. Aug 17 08:48:02.325128 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'id': 'f579cfbe-0b43-4710-8ba4-ba221a36e20b'} Aug 17 08:48:02.325945 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:48:02.325945 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:02.325945 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:48:02.325945 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:48:02.325945 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:48:02.325945 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:48:02.325945 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:48:02.325945 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:48:02.325945 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:48:02.325945 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:48:02.325945 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f579cfbe-0b43-4710-8ba4-ba221a36e20b could not be found. Aug 17 08:48:02.325945 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:02.325945 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:02.325945 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:02.325945 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:02.325945 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:02.325945 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:02.325945 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:48:02.325945 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:48:02.325945 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:48:02.327527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:48:02.327527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 08:48:02.327527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 08:48:02.327527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 08:48:02.327527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 08:48:02.327527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:48:02.327527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:48:02.327527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:48:02.327527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:48:02.327527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f579cfbe-0b43-4710-8ba4-ba221a36e20b could not be found. Aug 17 08:48:02.327527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:02.327527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:02.327527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:02.327527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:02.327527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:02.327527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:02.327527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:48:02.327527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:48:02.327527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f579cfbe-0b43-4710-8ba4-ba221a36e20b could not be found. Aug 17 08:48:02.327527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:02.329192 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-906ef240-0258-4ad0-9863-3f33134f7715 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Returning 404 to user: Instance f579cfbe-0b43-4710-8ba4-ba221a36e20b could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:48:02.329192 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-906ef240-0258-4ad0-9863-3f33134f7715 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 404 len: 111 microversion: 2.20 time: 0.030406 Aug 17 08:48:02.329192 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 432/877] 10.222.0.15 () {60 vars in 1280 bytes} [Wed Aug 17 08:48:02 2022] DELETE /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 08:48:02.333900 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ca28ed3d-6496-4d52-8c37-11a847393031 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:02.334563 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ca28ed3d-6496-4d52-8c37-11a847393031 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: f579cfbe-0b43-4710-8ba4-ba221a36e20b] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:02.340281 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ca28ed3d-6496-4d52-8c37-11a847393031 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:02.340763 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ca28ed3d-6496-4d52-8c37-11a847393031 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:02.341209 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ca28ed3d-6496-4d52-8c37-11a847393031 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:02.341893 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ca28ed3d-6496-4d52-8c37-11a847393031 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:02.342348 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ca28ed3d-6496-4d52-8c37-11a847393031 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:02.342772 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ca28ed3d-6496-4d52-8c37-11a847393031 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:02.356001 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-ca28ed3d-6496-4d52-8c37-11a847393031 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] HTTP exception thrown: Instance f579cfbe-0b43-4710-8ba4-ba221a36e20b could not be found. Aug 17 08:48:02.357546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ca28ed3d-6496-4d52-8c37-11a847393031 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Request method failure captured: Aug 17 08:48:02.357546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b HTTP/1.1 Aug 17 08:48:02.357546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:48:02.357546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:48:02.357546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:48:02.357546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:48:02.357546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:48:02.357546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:48:02.357546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:48:02.357546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:48:02.357546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_KohAvYrj5W_Z2jwMlBluU7GmlTT6O13XSVTTrpCjQZCZ4ES-7SLbpYEtZZzleqAbqMnkPUGFxsUNXl7LcEs8lxDpkhyA4NBFQuijl1q1Ogx24ms9LWq0vojzRLUXurTqBPcgv66wuXR4dQy0vXjpDAnNUyS0L35h6loPA8VXRTK6PE Aug 17 08:48:02.357546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:48:02.357546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:48:02.357546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:48:02.357546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:48:02.357546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 08:48:02.357546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:48:02.357546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:48:02.357546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: eb857c94e3f6405baad84dfc45445b0d Aug 17 08:48:02.357546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-296675391 Aug 17 08:48:02.357546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:48:02.357546 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:48:02.359189 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb857c94e3f6405baad84dfc45445b0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/eb857c94e3f6405baad84dfc45445b0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb857c94e3f6405baad84dfc45445b0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_eb857c94e3f6405baad84dfc45445b0d", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:48:02.359189 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-AttachVolumeShelveTestJSON-296675391 Aug 17 08:48:02.359189 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: eb857c94e3f6405baad84dfc45445b0d Aug 17 08:48:02.359189 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-296675391 Aug 17 08:48:02.359189 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-AttachVolumeShelveTestJSON-296675391-project Aug 17 08:48:02.359189 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:48:02.359189 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:48:02.359189 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: d586af36267c475ab5af42a23ce3f1b1 Aug 17 08:48:02.359189 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-AttachVolumeShelveTestJSON-296675391-project Aug 17 08:48:02.359189 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: > Aug 17 08:48:02.359189 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Instance f579cfbe-0b43-4710-8ba4-ba221a36e20b could not be found. Aug 17 08:48:02.359189 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': 'f579cfbe-0b43-4710-8ba4-ba221a36e20b'} Aug 17 08:48:02.360273 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:48:02.360273 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:02.360273 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:48:02.360273 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:48:02.360273 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:48:02.360273 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:48:02.360273 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:48:02.360273 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:48:02.360273 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:48:02.360273 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:48:02.360273 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f579cfbe-0b43-4710-8ba4-ba221a36e20b could not be found. Aug 17 08:48:02.360273 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:02.360273 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:02.360273 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:02.360273 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:02.360273 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:02.360273 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:02.360273 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:48:02.360273 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:48:02.360273 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:48:02.361775 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:48:02.361775 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:48:02.361775 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:48:02.361775 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:48:02.361775 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:48:02.361775 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:48:02.361775 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:48:02.361775 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f579cfbe-0b43-4710-8ba4-ba221a36e20b could not be found. Aug 17 08:48:02.361775 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:02.361775 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:02.361775 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:02.361775 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:02.361775 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:02.361775 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:02.361775 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:48:02.361775 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:48:02.361775 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f579cfbe-0b43-4710-8ba4-ba221a36e20b could not be found. Aug 17 08:48:02.361775 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:02.363192 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ca28ed3d-6496-4d52-8c37-11a847393031 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Returning 404 to user: Instance f579cfbe-0b43-4710-8ba4-ba221a36e20b could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:48:02.363192 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ca28ed3d-6496-4d52-8c37-11a847393031 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b" status: 404 len: 111 microversion: 2.20 time: 0.029149 Aug 17 08:48:02.363192 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 446/878] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:48:02 2022] GET /compute/v2.1/servers/f579cfbe-0b43-4710-8ba4-ba221a36e20b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 08:48:02.994109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8a272063-9416-4183-8ec6-2eee374b083e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:02.994699 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8a272063-9416-4183-8ec6-2eee374b083e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 722b88a8-8b51-445c-905e-8184f2411d12] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:03.000490 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8a272063-9416-4183-8ec6-2eee374b083e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:03.000965 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8a272063-9416-4183-8ec6-2eee374b083e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:03.001390 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8a272063-9416-4183-8ec6-2eee374b083e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:03.002056 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8a272063-9416-4183-8ec6-2eee374b083e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:03.002692 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8a272063-9416-4183-8ec6-2eee374b083e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:03.003112 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8a272063-9416-4183-8ec6-2eee374b083e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:03.134523 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8a272063-9416-4183-8ec6-2eee374b083e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:48:03.142136 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8a272063-9416-4183-8ec6-2eee374b083e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12" status: 200 len: 1265 microversion: 2.1 time: 0.151585 Aug 17 08:48:03.142455 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 433/879] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:48:02 2022] GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:48:03.499257 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1bc18eac-8e94-4a15-9dff-65d607777764 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:03.499797 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1bc18eac-8e94-4a15-9dff-65d607777764 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:03.505696 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1bc18eac-8e94-4a15-9dff-65d607777764 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:03.506178 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1bc18eac-8e94-4a15-9dff-65d607777764 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:03.506616 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1bc18eac-8e94-4a15-9dff-65d607777764 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:03.507305 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1bc18eac-8e94-4a15-9dff-65d607777764 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:03.507782 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1bc18eac-8e94-4a15-9dff-65d607777764 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:03.508717 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1bc18eac-8e94-4a15-9dff-65d607777764 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:03.521818 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-1bc18eac-8e94-4a15-9dff-65d607777764 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] HTTP exception thrown: Instance 42e06cf4-bb49-4d51-93c1-3147069bd032 could not be found. Aug 17 08:48:03.523335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1bc18eac-8e94-4a15-9dff-65d607777764 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Request method failure captured: Aug 17 08:48:03.523335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: DELETE /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 HTTP/1.1 Aug 17 08:48:03.523335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:48:03.523335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:48:03.523335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:48:03.523335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:48:03.523335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:48:03.523335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:48:03.523335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:48:03.523335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:48:03.523335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_KohAvYrj5W_Z2jwMlBluU7GmlTT6O13XSVTTrpCjQZCZ4ES-7SLbpYEtZZzleqAbqMnkPUGFxsUNXl7LcEs8lxDpkhyA4NBFQuijl1q1Ogx24ms9LWq0vojzRLUXurTqBPcgv66wuXR4dQy0vXjpDAnNUyS0L35h6loPA8VXRTK6PE Aug 17 08:48:03.523335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:48:03.523335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:48:03.523335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:48:03.523335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:48:03.523335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 08:48:03.523335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:48:03.523335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:48:03.523335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: eb857c94e3f6405baad84dfc45445b0d Aug 17 08:48:03.523335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-296675391 Aug 17 08:48:03.523335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:48:03.523335 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:48:03.525617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb857c94e3f6405baad84dfc45445b0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/eb857c94e3f6405baad84dfc45445b0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb857c94e3f6405baad84dfc45445b0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_eb857c94e3f6405baad84dfc45445b0d", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:48:03.525617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-AttachVolumeShelveTestJSON-296675391 Aug 17 08:48:03.525617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: eb857c94e3f6405baad84dfc45445b0d Aug 17 08:48:03.525617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-296675391 Aug 17 08:48:03.525617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-AttachVolumeShelveTestJSON-296675391-project Aug 17 08:48:03.525617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:48:03.525617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:48:03.525617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: d586af36267c475ab5af42a23ce3f1b1 Aug 17 08:48:03.525617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-AttachVolumeShelveTestJSON-296675391-project Aug 17 08:48:03.525617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: > Aug 17 08:48:03.525617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Instance 42e06cf4-bb49-4d51-93c1-3147069bd032 could not be found. Aug 17 08:48:03.525617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': '42e06cf4-bb49-4d51-93c1-3147069bd032'} Aug 17 08:48:03.526565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:48:03.526565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:03.526565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:48:03.526565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:48:03.526565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:48:03.526565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:48:03.526565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:48:03.526565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:48:03.526565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:48:03.526565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:48:03.526565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42e06cf4-bb49-4d51-93c1-3147069bd032 could not be found. Aug 17 08:48:03.526565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:03.526565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:03.526565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:03.526565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:03.526565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:03.526565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:03.526565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:48:03.526565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:48:03.526565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:48:03.528124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:48:03.528124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 08:48:03.528124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 08:48:03.528124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 08:48:03.528124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 08:48:03.528124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:48:03.528124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:48:03.528124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:48:03.528124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:48:03.528124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42e06cf4-bb49-4d51-93c1-3147069bd032 could not be found. Aug 17 08:48:03.528124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:03.528124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:03.528124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:03.528124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:03.528124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:03.528124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:03.528124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:48:03.528124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:48:03.528124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42e06cf4-bb49-4d51-93c1-3147069bd032 could not be found. Aug 17 08:48:03.528124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:03.529594 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1bc18eac-8e94-4a15-9dff-65d607777764 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Returning 404 to user: Instance 42e06cf4-bb49-4d51-93c1-3147069bd032 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:48:03.529594 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1bc18eac-8e94-4a15-9dff-65d607777764 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "DELETE /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 404 len: 111 microversion: 2.20 time: 0.030138 Aug 17 08:48:03.529594 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 447/880] 10.222.0.15 () {60 vars in 1280 bytes} [Wed Aug 17 08:48:03 2022] DELETE /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 08:48:03.533618 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ecd9d8e1-a991-4239-af49-7c72bbe4d3a8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:03.534213 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ecd9d8e1-a991-4239-af49-7c72bbe4d3a8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] [instance: 42e06cf4-bb49-4d51-93c1-3147069bd032] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:03.540547 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ecd9d8e1-a991-4239-af49-7c72bbe4d3a8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:03.541014 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ecd9d8e1-a991-4239-af49-7c72bbe4d3a8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:03.541435 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ecd9d8e1-a991-4239-af49-7c72bbe4d3a8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:03.542102 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ecd9d8e1-a991-4239-af49-7c72bbe4d3a8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:03.542542 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ecd9d8e1-a991-4239-af49-7c72bbe4d3a8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:03.542951 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ecd9d8e1-a991-4239-af49-7c72bbe4d3a8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:03.555767 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-ecd9d8e1-a991-4239-af49-7c72bbe4d3a8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] HTTP exception thrown: Instance 42e06cf4-bb49-4d51-93c1-3147069bd032 could not be found. Aug 17 08:48:03.557314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ecd9d8e1-a991-4239-af49-7c72bbe4d3a8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Request method failure captured: Aug 17 08:48:03.557314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 HTTP/1.1 Aug 17 08:48:03.557314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:48:03.557314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:48:03.557314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:48:03.557314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:48:03.557314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:48:03.557314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:48:03.557314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:48:03.557314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:48:03.557314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_KohAvYrj5W_Z2jwMlBluU7GmlTT6O13XSVTTrpCjQZCZ4ES-7SLbpYEtZZzleqAbqMnkPUGFxsUNXl7LcEs8lxDpkhyA4NBFQuijl1q1Ogx24ms9LWq0vojzRLUXurTqBPcgv66wuXR4dQy0vXjpDAnNUyS0L35h6loPA8VXRTK6PE Aug 17 08:48:03.557314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:48:03.557314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:48:03.557314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:48:03.557314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:48:03.557314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 08:48:03.557314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:48:03.557314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:48:03.557314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: eb857c94e3f6405baad84dfc45445b0d Aug 17 08:48:03.557314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-296675391 Aug 17 08:48:03.557314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:48:03.557314 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:48:03.559248 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb857c94e3f6405baad84dfc45445b0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/eb857c94e3f6405baad84dfc45445b0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb857c94e3f6405baad84dfc45445b0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_eb857c94e3f6405baad84dfc45445b0d", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:48:03.559248 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeShelveTestJSON-296675391 Aug 17 08:48:03.559248 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: eb857c94e3f6405baad84dfc45445b0d Aug 17 08:48:03.559248 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-296675391 Aug 17 08:48:03.559248 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeShelveTestJSON-296675391-project Aug 17 08:48:03.559248 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:48:03.559248 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:48:03.559248 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: d586af36267c475ab5af42a23ce3f1b1 Aug 17 08:48:03.559248 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeShelveTestJSON-296675391-project Aug 17 08:48:03.559248 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:48:03.559248 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Instance 42e06cf4-bb49-4d51-93c1-3147069bd032 could not be found. Aug 17 08:48:03.559248 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'id': '42e06cf4-bb49-4d51-93c1-3147069bd032'} Aug 17 08:48:03.560082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:48:03.560082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:03.560082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:48:03.560082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:48:03.560082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:48:03.560082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:48:03.560082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:48:03.560082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:48:03.560082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:48:03.560082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:48:03.560082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42e06cf4-bb49-4d51-93c1-3147069bd032 could not be found. Aug 17 08:48:03.560082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:03.560082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:03.560082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:03.560082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:03.560082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:03.560082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:03.560082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:48:03.560082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:48:03.560082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:48:03.561401 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:48:03.561401 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:48:03.561401 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:48:03.561401 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:48:03.561401 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:48:03.561401 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:48:03.561401 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:48:03.561401 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42e06cf4-bb49-4d51-93c1-3147069bd032 could not be found. Aug 17 08:48:03.561401 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:03.561401 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:03.561401 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:03.561401 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:03.561401 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:03.561401 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:03.561401 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:48:03.561401 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:48:03.561401 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42e06cf4-bb49-4d51-93c1-3147069bd032 could not be found. Aug 17 08:48:03.561401 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:03.562553 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ecd9d8e1-a991-4239-af49-7c72bbe4d3a8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] Returning 404 to user: Instance 42e06cf4-bb49-4d51-93c1-3147069bd032 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:48:03.562553 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ecd9d8e1-a991-4239-af49-7c72bbe4d3a8 tempest-AttachVolumeShelveTestJSON-296675391 tempest-AttachVolumeShelveTestJSON-296675391-project] 10.222.0.15 "GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032" status: 404 len: 111 microversion: 2.20 time: 0.028847 Aug 17 08:48:03.562553 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 434/881] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 08:48:03 2022] GET /compute/v2.1/servers/42e06cf4-bb49-4d51-93c1-3147069bd032 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 17 08:48:04.161909 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-7c69e844-00f5-4ca5-944f-33bcf065a825 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:04.162523 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-7c69e844-00f5-4ca5-944f-33bcf065a825 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 722b88a8-8b51-445c-905e-8184f2411d12] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:04.168829 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7c69e844-00f5-4ca5-944f-33bcf065a825 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:04.169318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7c69e844-00f5-4ca5-944f-33bcf065a825 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:04.169750 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7c69e844-00f5-4ca5-944f-33bcf065a825 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:04.170433 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7c69e844-00f5-4ca5-944f-33bcf065a825 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:04.170883 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7c69e844-00f5-4ca5-944f-33bcf065a825 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:04.171306 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-7c69e844-00f5-4ca5-944f-33bcf065a825 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:04.385267 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-7c69e844-00f5-4ca5-944f-33bcf065a825 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:48:04.392736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-7c69e844-00f5-4ca5-944f-33bcf065a825 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12" status: 200 len: 1265 microversion: 2.1 time: 0.234691 Aug 17 08:48:04.393302 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 448/882] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:48:04 2022] GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:48:04.592045 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-9c157521-682a-4d91-9391-038c4f7ca01e req-e92d106f-8fc7-4b1a-80a3-f88d13ed39d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "722b88a8-8b51-445c-905e-8184f2411d12", "name": "network-vif-plugged", "status": "completed", "tag": "9fc7feb5-24f5-44ed-95e0-b35c8999de23"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:48:04.640549 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-9c157521-682a-4d91-9391-038c4f7ca01e req-e92d106f-8fc7-4b1a-80a3-f88d13ed39d8 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:04.644063 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-9c157521-682a-4d91-9391-038c4f7ca01e req-e92d106f-8fc7-4b1a-80a3-f88d13ed39d8 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:04.647980 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-9c157521-682a-4d91-9391-038c4f7ca01e req-e92d106f-8fc7-4b1a-80a3-f88d13ed39d8 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:04.675136 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-9c157521-682a-4d91-9391-038c4f7ca01e req-e92d106f-8fc7-4b1a-80a3-f88d13ed39d8 service nova] Creating event network-vif-plugged:9fc7feb5-24f5-44ed-95e0-b35c8999de23 for instance 722b88a8-8b51-445c-905e-8184f2411d12 on hv-cinder-85331 Aug 17 08:48:04.681153 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-9c157521-682a-4d91-9391-038c4f7ca01e req-e92d106f-8fc7-4b1a-80a3-f88d13ed39d8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095400 Aug 17 08:48:04.682524 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 435/883] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:48:05.413593 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5278ea6d-9253-4207-9c21-1d919377f89b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:05.414188 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-5278ea6d-9253-4207-9c21-1d919377f89b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 722b88a8-8b51-445c-905e-8184f2411d12] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:05.425927 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5278ea6d-9253-4207-9c21-1d919377f89b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:05.426427 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5278ea6d-9253-4207-9c21-1d919377f89b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:05.427110 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5278ea6d-9253-4207-9c21-1d919377f89b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:05.427789 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5278ea6d-9253-4207-9c21-1d919377f89b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:05.428450 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5278ea6d-9253-4207-9c21-1d919377f89b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:05.428824 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5278ea6d-9253-4207-9c21-1d919377f89b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:05.691979 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-5278ea6d-9253-4207-9c21-1d919377f89b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:48:05.699983 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-5278ea6d-9253-4207-9c21-1d919377f89b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12" status: 200 len: 1265 microversion: 2.1 time: 0.290134 Aug 17 08:48:05.700559 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 449/884] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:48:05 2022] GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12 => generated 1265 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:48:06.721737 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1dee0e43-a18a-4ab3-827b-536e99ed81a3 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:06.722507 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1dee0e43-a18a-4ab3-827b-536e99ed81a3 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 722b88a8-8b51-445c-905e-8184f2411d12] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:06.729528 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1dee0e43-a18a-4ab3-827b-536e99ed81a3 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:06.730013 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1dee0e43-a18a-4ab3-827b-536e99ed81a3 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:06.730441 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1dee0e43-a18a-4ab3-827b-536e99ed81a3 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:06.731159 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1dee0e43-a18a-4ab3-827b-536e99ed81a3 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:06.731832 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1dee0e43-a18a-4ab3-827b-536e99ed81a3 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:06.732538 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1dee0e43-a18a-4ab3-827b-536e99ed81a3 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:06.888626 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1dee0e43-a18a-4ab3-827b-536e99ed81a3 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:48:06.896705 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1dee0e43-a18a-4ab3-827b-536e99ed81a3 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12" status: 200 len: 1452 microversion: 2.1 time: 0.179590 Aug 17 08:48:06.897566 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 436/885] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:48:06 2022] GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12 => generated 1452 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:48:06.917168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e9dcef2d-eabf-4dd3-b72a-3101d1e05dbb tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:06.917772 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e9dcef2d-eabf-4dd3-b72a-3101d1e05dbb tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 722b88a8-8b51-445c-905e-8184f2411d12] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:06.924410 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9dcef2d-eabf-4dd3-b72a-3101d1e05dbb tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:06.925081 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9dcef2d-eabf-4dd3-b72a-3101d1e05dbb tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:06.925716 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9dcef2d-eabf-4dd3-b72a-3101d1e05dbb tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:06.926416 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9dcef2d-eabf-4dd3-b72a-3101d1e05dbb tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:06.926869 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9dcef2d-eabf-4dd3-b72a-3101d1e05dbb tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:06.927291 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-e9dcef2d-eabf-4dd3-b72a-3101d1e05dbb tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:07.065435 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e9dcef2d-eabf-4dd3-b72a-3101d1e05dbb tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:48:07.073134 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e9dcef2d-eabf-4dd3-b72a-3101d1e05dbb tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12" status: 200 len: 1452 microversion: 2.1 time: 0.160130 Aug 17 08:48:07.074069 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 450/886] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:48:06 2022] GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:48:08.790980 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-b146bc6b-4844-4d89-bb48-11255051fa72 req-ea6185c6-91d0-4b69-b307-b48e469693d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "722b88a8-8b51-445c-905e-8184f2411d12", "tag": "9fc7feb5-24f5-44ed-95e0-b35c8999de23"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:48:08.800996 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-b146bc6b-4844-4d89-bb48-11255051fa72 req-ea6185c6-91d0-4b69-b307-b48e469693d0 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:08.801732 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-b146bc6b-4844-4d89-bb48-11255051fa72 req-ea6185c6-91d0-4b69-b307-b48e469693d0 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:08.802151 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-b146bc6b-4844-4d89-bb48-11255051fa72 req-ea6185c6-91d0-4b69-b307-b48e469693d0 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:08.813932 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-b146bc6b-4844-4d89-bb48-11255051fa72 req-ea6185c6-91d0-4b69-b307-b48e469693d0 service nova] Creating event network-changed:9fc7feb5-24f5-44ed-95e0-b35c8999de23 for instance 722b88a8-8b51-445c-905e-8184f2411d12 on hv-cinder-85331 Aug 17 08:48:08.819642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-b146bc6b-4844-4d89-bb48-11255051fa72 req-ea6185c6-91d0-4b69-b307-b48e469693d0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032906 Aug 17 08:48:08.820356 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 437/887] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:48:25.999174 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-d5dfde33-4aa7-49f2-9132-4cf31088219e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:25.999819 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-d5dfde33-4aa7-49f2-9132-4cf31088219e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 72836909-95a3-4172-adcb-33fd1456a1f2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:26.002243 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:26.002918 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=22 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:26.009454 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d5dfde33-4aa7-49f2-9132-4cf31088219e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:26.009930 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d5dfde33-4aa7-49f2-9132-4cf31088219e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:26.010356 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d5dfde33-4aa7-49f2-9132-4cf31088219e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:26.011032 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d5dfde33-4aa7-49f2-9132-4cf31088219e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:26.011475 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d5dfde33-4aa7-49f2-9132-4cf31088219e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:26.011941 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-d5dfde33-4aa7-49f2-9132-4cf31088219e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:26.035034 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-d5dfde33-4aa7-49f2-9132-4cf31088219e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2/ips" status: 200 len: 149 microversion: 2.1 time: 0.039745 Aug 17 08:48:26.035590 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 451/888] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 08:48:25 2022] GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:48:27.353580 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-39cedc4f-fc18-42c7-bc93-56c9b36be029 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc234779-9500-48f2-b2be-047c566c8544"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:48:27.355999 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-39cedc4f-fc18-42c7-bc93-56c9b36be029 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 72836909-95a3-4172-adcb-33fd1456a1f2] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:27.358721 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:27.359355 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:27.366015 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39cedc4f-fc18-42c7-bc93-56c9b36be029 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:27.366486 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39cedc4f-fc18-42c7-bc93-56c9b36be029 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:27.366911 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39cedc4f-fc18-42c7-bc93-56c9b36be029 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:27.367610 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39cedc4f-fc18-42c7-bc93-56c9b36be029 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:27.368056 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39cedc4f-fc18-42c7-bc93-56c9b36be029 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:27.368470 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-39cedc4f-fc18-42c7-bc93-56c9b36be029 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:27.627876 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-39cedc4f-fc18-42c7-bc93-56c9b36be029 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "POST /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278693 Aug 17 08:48:27.628472 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 438/889] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 08:48:27 2022] POST /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:48:36.306216 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-b58a454a-80d3-4b18-9012-85eb4be937ee tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:36.306702 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-b58a454a-80d3-4b18-9012-85eb4be937ee tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 72836909-95a3-4172-adcb-33fd1456a1f2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:36.308820 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:36.309451 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=4 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:36.314773 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b58a454a-80d3-4b18-9012-85eb4be937ee tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:36.315255 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b58a454a-80d3-4b18-9012-85eb4be937ee tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:36.315727 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b58a454a-80d3-4b18-9012-85eb4be937ee tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:36.316407 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b58a454a-80d3-4b18-9012-85eb4be937ee tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:36.316859 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b58a454a-80d3-4b18-9012-85eb4be937ee tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:36.317275 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-b58a454a-80d3-4b18-9012-85eb4be937ee tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:36.395566 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.objects.instance [None req-b58a454a-80d3-4b18-9012-85eb4be937ee tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lazy-loading 'services' on Instance uuid 72836909-95a3-4172-adcb-33fd1456a1f2 {{(pid=127297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:48:36.466072 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-b58a454a-80d3-4b18-9012-85eb4be937ee tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "DELETE /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2/os-volume_attachments/fc234779-9500-48f2-b2be-047c566c8544" status: 202 len: 0 microversion: 2.1 time: 0.163531 Aug 17 08:48:36.466820 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 452/890] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 08:48:36 2022] DELETE /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2/os-volume_attachments/fc234779-9500-48f2-b2be-047c566c8544 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:48:36.475675 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-67e9d267-fb85-43b0-b4bf-e125d781e5fe tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:36.478537 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-67e9d267-fb85-43b0-b4bf-e125d781e5fe tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 72836909-95a3-4172-adcb-33fd1456a1f2] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:36.485567 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-67e9d267-fb85-43b0-b4bf-e125d781e5fe tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:36.486055 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-67e9d267-fb85-43b0-b4bf-e125d781e5fe tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:36.486528 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-67e9d267-fb85-43b0-b4bf-e125d781e5fe tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:36.487288 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-67e9d267-fb85-43b0-b4bf-e125d781e5fe tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:36.487770 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-67e9d267-fb85-43b0-b4bf-e125d781e5fe tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:36.488279 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-67e9d267-fb85-43b0-b4bf-e125d781e5fe tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:36.518983 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-67e9d267-fb85-43b0-b4bf-e125d781e5fe tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047586 Aug 17 08:48:36.519750 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 439/891] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 08:48:36 2022] GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:48:37.531451 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-cf73a0e3-6559-4357-b535-94b123aba96f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:37.533720 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-cf73a0e3-6559-4357-b535-94b123aba96f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 72836909-95a3-4172-adcb-33fd1456a1f2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:37.540429 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cf73a0e3-6559-4357-b535-94b123aba96f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:37.540902 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cf73a0e3-6559-4357-b535-94b123aba96f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:37.541325 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cf73a0e3-6559-4357-b535-94b123aba96f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:37.541995 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cf73a0e3-6559-4357-b535-94b123aba96f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:37.542438 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cf73a0e3-6559-4357-b535-94b123aba96f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:37.542856 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-cf73a0e3-6559-4357-b535-94b123aba96f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:37.571331 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-cf73a0e3-6559-4357-b535-94b123aba96f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044701 Aug 17 08:48:37.571933 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 453/892] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 08:48:37 2022] GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 08:48:37.636216 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8cb49e8a-10f0-4f66-9a62-67d82946b45f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:37.636702 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8cb49e8a-10f0-4f66-9a62-67d82946b45f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 72836909-95a3-4172-adcb-33fd1456a1f2] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:37.643131 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8cb49e8a-10f0-4f66-9a62-67d82946b45f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:37.643635 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8cb49e8a-10f0-4f66-9a62-67d82946b45f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:37.644068 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8cb49e8a-10f0-4f66-9a62-67d82946b45f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:37.644746 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8cb49e8a-10f0-4f66-9a62-67d82946b45f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:37.645195 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8cb49e8a-10f0-4f66-9a62-67d82946b45f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:37.645614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8cb49e8a-10f0-4f66-9a62-67d82946b45f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:37.670753 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8cb49e8a-10f0-4f66-9a62-67d82946b45f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 72836909-95a3-4172-adcb-33fd1456a1f2] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 08:48:37.744937 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8cb49e8a-10f0-4f66-9a62-67d82946b45f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "DELETE /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2" status: 204 len: 0 microversion: 2.1 time: 0.112247 Aug 17 08:48:37.745517 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 440/893] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:48:37 2022] DELETE /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 08:48:37.754994 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-6b139d0e-4c48-480b-9484-f31318970dad tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:37.755625 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-6b139d0e-4c48-480b-9484-f31318970dad tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 72836909-95a3-4172-adcb-33fd1456a1f2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:37.762728 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6b139d0e-4c48-480b-9484-f31318970dad tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:37.763215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6b139d0e-4c48-480b-9484-f31318970dad tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:37.763884 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6b139d0e-4c48-480b-9484-f31318970dad tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:37.764764 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6b139d0e-4c48-480b-9484-f31318970dad tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:37.765279 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6b139d0e-4c48-480b-9484-f31318970dad tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:37.765827 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-6b139d0e-4c48-480b-9484-f31318970dad tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:37.901322 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-6b139d0e-4c48-480b-9484-f31318970dad tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:48:37.908840 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-6b139d0e-4c48-480b-9484-f31318970dad tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2" status: 200 len: 1681 microversion: 2.1 time: 0.158460 Aug 17 08:48:37.909398 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 454/894] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:48:37 2022] GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:48:38.931213 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a9154b8d-9f7a-4628-b7ff-6e2915aeda81 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:38.931927 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a9154b8d-9f7a-4628-b7ff-6e2915aeda81 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 72836909-95a3-4172-adcb-33fd1456a1f2] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:38.938170 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a9154b8d-9f7a-4628-b7ff-6e2915aeda81 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:38.938643 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a9154b8d-9f7a-4628-b7ff-6e2915aeda81 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:38.939076 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a9154b8d-9f7a-4628-b7ff-6e2915aeda81 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:38.939829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a9154b8d-9f7a-4628-b7ff-6e2915aeda81 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:38.940246 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a9154b8d-9f7a-4628-b7ff-6e2915aeda81 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:38.940667 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-a9154b8d-9f7a-4628-b7ff-6e2915aeda81 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:39.074060 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a9154b8d-9f7a-4628-b7ff-6e2915aeda81 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:48:39.081535 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a9154b8d-9f7a-4628-b7ff-6e2915aeda81 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2" status: 200 len: 1681 microversion: 2.1 time: 0.154597 Aug 17 08:48:39.082092 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 441/895] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:48:38 2022] GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:48:40.102637 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-9d2641c6-fea2-46d0-a3c5-489f966718e3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:40.103389 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-9d2641c6-fea2-46d0-a3c5-489f966718e3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 72836909-95a3-4172-adcb-33fd1456a1f2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:40.109939 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d2641c6-fea2-46d0-a3c5-489f966718e3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:40.110488 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d2641c6-fea2-46d0-a3c5-489f966718e3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:40.110986 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d2641c6-fea2-46d0-a3c5-489f966718e3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:40.111772 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d2641c6-fea2-46d0-a3c5-489f966718e3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:40.112285 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d2641c6-fea2-46d0-a3c5-489f966718e3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:40.112770 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9d2641c6-fea2-46d0-a3c5-489f966718e3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:40.175693 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-9d2641c6-fea2-46d0-a3c5-489f966718e3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49114d25c04144269e3eb88448e2c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b106e46b2c4fb292353a6176c9f699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:48:40.183709 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-9d2641c6-fea2-46d0-a3c5-489f966718e3 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2" status: 200 len: 1613 microversion: 2.1 time: 0.085278 Aug 17 08:48:40.184355 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 455/896] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:48:40 2022] GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2 => generated 1613 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:48:40.256580 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-495f6ae3-bf11-42a9-9b46-85f1eb4b6384 req-1fb18c38-8098-4070-8797-05eba6f3f808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72836909-95a3-4172-adcb-33fd1456a1f2", "name": "network-vif-deleted", "tag": "ead17ae3-59ab-46bd-b875-4892f71bccf0"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:48:40.269603 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-495f6ae3-bf11-42a9-9b46-85f1eb4b6384 req-1fb18c38-8098-4070-8797-05eba6f3f808 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:40.269999 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-495f6ae3-bf11-42a9-9b46-85f1eb4b6384 req-1fb18c38-8098-4070-8797-05eba6f3f808 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:40.270416 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-495f6ae3-bf11-42a9-9b46-85f1eb4b6384 req-1fb18c38-8098-4070-8797-05eba6f3f808 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:40.282595 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-495f6ae3-bf11-42a9-9b46-85f1eb4b6384 req-1fb18c38-8098-4070-8797-05eba6f3f808 service nova] Creating event network-vif-deleted:ead17ae3-59ab-46bd-b875-4892f71bccf0 for instance 72836909-95a3-4172-adcb-33fd1456a1f2 on hv-cinder-85331 Aug 17 08:48:40.288607 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-495f6ae3-bf11-42a9-9b46-85f1eb4b6384 req-1fb18c38-8098-4070-8797-05eba6f3f808 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036091 Aug 17 08:48:40.289197 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 442/897] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:48:41.205894 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-985a0753-2542-4da9-b0e4-73a353e37bf5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:41.207104 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-985a0753-2542-4da9-b0e4-73a353e37bf5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 72836909-95a3-4172-adcb-33fd1456a1f2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:41.215883 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-985a0753-2542-4da9-b0e4-73a353e37bf5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:41.216367 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-985a0753-2542-4da9-b0e4-73a353e37bf5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:41.216986 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-985a0753-2542-4da9-b0e4-73a353e37bf5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:41.217853 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-985a0753-2542-4da9-b0e4-73a353e37bf5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:41.218495 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-985a0753-2542-4da9-b0e4-73a353e37bf5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:41.219086 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-985a0753-2542-4da9-b0e4-73a353e37bf5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:41.233105 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-985a0753-2542-4da9-b0e4-73a353e37bf5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] HTTP exception thrown: Instance 72836909-95a3-4172-adcb-33fd1456a1f2 could not be found. Aug 17 08:48:41.235138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-985a0753-2542-4da9-b0e4-73a353e37bf5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Request method failure captured: Aug 17 08:48:41.235138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2 HTTP/1.1 Aug 17 08:48:41.235138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:48:41.235138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:48:41.235138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:48:41.235138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:48:41.235138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:48:41.235138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:48:41.235138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:48:41.235138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:48:41.235138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_KpFdcvpXRpf5-5Y1Bcdp25cETTaZP2GCfDiMsQtuC72_QvaOW9RGOTA8kn7uQkIZJZ1MZAapBPaWHtaHUw4ZxHYKXMP1ga8b2c-T6hV70Qk5k-OaBMweSR-NFttqfscTAbrcBgHODlMBBOScpWQJnArcc-Q8jX8Dn-V-35da8hxuVI Aug 17 08:48:41.235138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:48:41.235138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:48:41.235138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:48:41.235138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:48:41.235138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:48:41.235138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:48:41.235138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:48:41.235138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:41.235138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:48:41.235138 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:48:41.237206 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_34b106e46b2c4fb292353a6176c9f699", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:48:41.237206 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:41.237206 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:48:41.237206 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:41.237206 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:48:41.237206 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:48:41.237206 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:48:41.237206 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: 49114d25c04144269e3eb88448e2c2ee Aug 17 08:48:41.237206 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:48:41.237206 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: > Aug 17 08:48:41.237206 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Instance 72836909-95a3-4172-adcb-33fd1456a1f2 could not be found. Aug 17 08:48:41.237206 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': '72836909-95a3-4172-adcb-33fd1456a1f2'} Aug 17 08:48:41.238454 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:48:41.238454 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:41.238454 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:48:41.238454 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:48:41.238454 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:48:41.238454 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:48:41.238454 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:48:41.238454 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:48:41.238454 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:48:41.238454 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:48:41.238454 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72836909-95a3-4172-adcb-33fd1456a1f2 could not be found. Aug 17 08:48:41.238454 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:41.238454 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:41.238454 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:41.238454 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:41.238454 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:41.238454 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:41.238454 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:48:41.238454 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:48:41.238454 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:48:41.240378 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:48:41.240378 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:48:41.240378 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:48:41.240378 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:48:41.240378 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:48:41.240378 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:48:41.240378 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:48:41.240378 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72836909-95a3-4172-adcb-33fd1456a1f2 could not be found. Aug 17 08:48:41.240378 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:41.240378 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:41.240378 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:41.240378 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:41.240378 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:41.240378 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:41.240378 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:48:41.240378 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:48:41.240378 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72836909-95a3-4172-adcb-33fd1456a1f2 could not be found. Aug 17 08:48:41.240378 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:41.241868 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-985a0753-2542-4da9-b0e4-73a353e37bf5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Returning 404 to user: Instance 72836909-95a3-4172-adcb-33fd1456a1f2 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:48:41.241868 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-985a0753-2542-4da9-b0e4-73a353e37bf5 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2" status: 404 len: 111 microversion: 2.1 time: 0.034492 Aug 17 08:48:41.241868 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 456/898] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:48:41 2022] GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:48:41.249557 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2d2b7751-17f0-44ee-925c-f081449b474b tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '.version_select at 0x7f3f85177a60>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:41.272417 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2d2b7751-17f0-44ee-925c-f081449b474b tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-301939902" status: 202 len: 0 microversion: 2.1 time: 0.027333 Aug 17 08:48:41.277304 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 443/899] 10.222.0.15 () {58 vars in 1218 bytes} [Wed Aug 17 08:48:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-301939902 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:48:45.110325 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-89ad6c7c-37e0-4ef8-b12a-499868b1cf0a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:45.110819 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-89ad6c7c-37e0-4ef8-b12a-499868b1cf0a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 72836909-95a3-4172-adcb-33fd1456a1f2] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:45.117300 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-89ad6c7c-37e0-4ef8-b12a-499868b1cf0a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:45.118449 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-89ad6c7c-37e0-4ef8-b12a-499868b1cf0a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:45.118887 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-89ad6c7c-37e0-4ef8-b12a-499868b1cf0a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:45.119598 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-89ad6c7c-37e0-4ef8-b12a-499868b1cf0a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:45.120055 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-89ad6c7c-37e0-4ef8-b12a-499868b1cf0a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:45.120484 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-89ad6c7c-37e0-4ef8-b12a-499868b1cf0a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:45.133805 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-89ad6c7c-37e0-4ef8-b12a-499868b1cf0a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] HTTP exception thrown: Instance 72836909-95a3-4172-adcb-33fd1456a1f2 could not be found. Aug 17 08:48:45.135318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-89ad6c7c-37e0-4ef8-b12a-499868b1cf0a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Request method failure captured: Aug 17 08:48:45.135318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: DELETE /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2 HTTP/1.1 Aug 17 08:48:45.135318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:48:45.135318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:48:45.135318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:48:45.135318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:48:45.135318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:48:45.135318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:48:45.135318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:48:45.135318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:48:45.135318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_KpFdcvpXRpf5-5Y1Bcdp25cETTaZP2GCfDiMsQtuC72_QvaOW9RGOTA8kn7uQkIZJZ1MZAapBPaWHtaHUw4ZxHYKXMP1ga8b2c-T6hV70Qk5k-OaBMweSR-NFttqfscTAbrcBgHODlMBBOScpWQJnArcc-Q8jX8Dn-V-35da8hxuVI Aug 17 08:48:45.135318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:48:45.135318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:48:45.135318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:48:45.135318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:48:45.135318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:48:45.135318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:48:45.135318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:48:45.135318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:45.135318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:48:45.135318 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:48:45.137029 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_34b106e46b2c4fb292353a6176c9f699", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:48:45.137029 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:45.137029 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:48:45.137029 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:45.137029 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:48:45.137029 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:48:45.137029 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:48:45.137029 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: 49114d25c04144269e3eb88448e2c2ee Aug 17 08:48:45.137029 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:48:45.137029 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: > Aug 17 08:48:45.137029 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Instance 72836909-95a3-4172-adcb-33fd1456a1f2 could not be found. Aug 17 08:48:45.137029 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': '72836909-95a3-4172-adcb-33fd1456a1f2'} Aug 17 08:48:45.137910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:48:45.137910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:45.137910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:48:45.137910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:48:45.137910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:48:45.137910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:48:45.137910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:48:45.137910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:48:45.137910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:48:45.137910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:48:45.137910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72836909-95a3-4172-adcb-33fd1456a1f2 could not be found. Aug 17 08:48:45.137910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:45.137910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:45.137910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:45.137910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:45.137910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:45.137910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:45.137910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:48:45.137910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:48:45.137910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:48:45.139201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:48:45.139201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 08:48:45.139201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 08:48:45.139201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 08:48:45.139201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 08:48:45.139201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:48:45.139201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:48:45.139201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:48:45.139201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:48:45.139201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72836909-95a3-4172-adcb-33fd1456a1f2 could not be found. Aug 17 08:48:45.139201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:45.139201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:45.139201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:45.139201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:45.139201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:45.139201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:45.139201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:48:45.139201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:48:45.139201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72836909-95a3-4172-adcb-33fd1456a1f2 could not be found. Aug 17 08:48:45.139201 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:45.140593 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-89ad6c7c-37e0-4ef8-b12a-499868b1cf0a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Returning 404 to user: Instance 72836909-95a3-4172-adcb-33fd1456a1f2 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:48:45.140593 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-89ad6c7c-37e0-4ef8-b12a-499868b1cf0a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "DELETE /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2" status: 404 len: 111 microversion: 2.1 time: 0.030209 Aug 17 08:48:45.140593 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 457/900] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:48:45 2022] DELETE /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:48:45.145158 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-4b985277-cc83-46c2-bb70-5d37e1379e2a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:45.145891 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-4b985277-cc83-46c2-bb70-5d37e1379e2a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 72836909-95a3-4172-adcb-33fd1456a1f2] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:45.152840 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4b985277-cc83-46c2-bb70-5d37e1379e2a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:45.153319 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4b985277-cc83-46c2-bb70-5d37e1379e2a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:45.153741 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4b985277-cc83-46c2-bb70-5d37e1379e2a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:45.154416 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4b985277-cc83-46c2-bb70-5d37e1379e2a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:45.154861 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4b985277-cc83-46c2-bb70-5d37e1379e2a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:45.155278 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-4b985277-cc83-46c2-bb70-5d37e1379e2a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:45.168734 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-4b985277-cc83-46c2-bb70-5d37e1379e2a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] HTTP exception thrown: Instance 72836909-95a3-4172-adcb-33fd1456a1f2 could not be found. Aug 17 08:48:45.170340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-4b985277-cc83-46c2-bb70-5d37e1379e2a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Request method failure captured: Aug 17 08:48:45.170340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2 HTTP/1.1 Aug 17 08:48:45.170340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:48:45.170340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:48:45.170340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:48:45.170340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:48:45.170340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:48:45.170340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:48:45.170340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:48:45.170340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:48:45.170340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_KpFdcvpXRpf5-5Y1Bcdp25cETTaZP2GCfDiMsQtuC72_QvaOW9RGOTA8kn7uQkIZJZ1MZAapBPaWHtaHUw4ZxHYKXMP1ga8b2c-T6hV70Qk5k-OaBMweSR-NFttqfscTAbrcBgHODlMBBOScpWQJnArcc-Q8jX8Dn-V-35da8hxuVI Aug 17 08:48:45.170340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:48:45.170340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:48:45.170340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:48:45.170340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:48:45.170340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:48:45.170340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:48:45.170340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:48:45.170340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:45.170340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:48:45.170340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:48:45.172072 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_34b106e46b2c4fb292353a6176c9f699", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:48:45.172072 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:45.172072 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:48:45.172072 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:45.172072 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:48:45.172072 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:48:45.172072 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:48:45.172072 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: 49114d25c04144269e3eb88448e2c2ee Aug 17 08:48:45.172072 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:48:45.172072 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:48:45.172072 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Instance 72836909-95a3-4172-adcb-33fd1456a1f2 could not be found. Aug 17 08:48:45.172072 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'id': '72836909-95a3-4172-adcb-33fd1456a1f2'} Aug 17 08:48:45.173109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:48:45.173109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:45.173109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:48:45.173109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:48:45.173109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:48:45.173109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:48:45.173109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:48:45.173109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:48:45.173109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:48:45.173109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:48:45.173109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72836909-95a3-4172-adcb-33fd1456a1f2 could not be found. Aug 17 08:48:45.173109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:45.173109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:45.173109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:45.173109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:45.173109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:45.173109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:45.173109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:48:45.173109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:48:45.173109 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:48:45.174718 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:48:45.174718 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:48:45.174718 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:48:45.174718 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:48:45.174718 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:48:45.174718 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:48:45.174718 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:48:45.174718 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72836909-95a3-4172-adcb-33fd1456a1f2 could not be found. Aug 17 08:48:45.174718 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:45.174718 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:45.174718 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:45.174718 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:45.174718 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:45.174718 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:45.174718 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:48:45.174718 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:48:45.174718 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72836909-95a3-4172-adcb-33fd1456a1f2 could not be found. Aug 17 08:48:45.174718 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:45.176182 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-4b985277-cc83-46c2-bb70-5d37e1379e2a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Returning 404 to user: Instance 72836909-95a3-4172-adcb-33fd1456a1f2 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:48:45.176182 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-4b985277-cc83-46c2-bb70-5d37e1379e2a tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2" status: 404 len: 111 microversion: 2.1 time: 0.030373 Aug 17 08:48:45.176182 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 444/901] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:48:45 2022] GET /compute/v2.1/servers/72836909-95a3-4172-adcb-33fd1456a1f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:48:46.310534 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-378c296e-579a-41cb-9939-7809e028602d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:46.311062 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-378c296e-579a-41cb-9939-7809e028602d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 43b85b50-c35a-4f5e-a5cc-c67859166b3c] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:46.317557 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-378c296e-579a-41cb-9939-7809e028602d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:46.318164 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-378c296e-579a-41cb-9939-7809e028602d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:46.318463 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-378c296e-579a-41cb-9939-7809e028602d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:46.319151 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-378c296e-579a-41cb-9939-7809e028602d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:46.319632 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-378c296e-579a-41cb-9939-7809e028602d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:46.320058 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-378c296e-579a-41cb-9939-7809e028602d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:46.334024 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-378c296e-579a-41cb-9939-7809e028602d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] HTTP exception thrown: Instance 43b85b50-c35a-4f5e-a5cc-c67859166b3c could not be found. Aug 17 08:48:46.335561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-378c296e-579a-41cb-9939-7809e028602d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Request method failure captured: Aug 17 08:48:46.335561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: DELETE /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c HTTP/1.1 Aug 17 08:48:46.335561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:48:46.335561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:48:46.335561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:48:46.335561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:48:46.335561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:48:46.335561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:48:46.335561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:48:46.335561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:48:46.335561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_KpFdcvpXRpf5-5Y1Bcdp25cETTaZP2GCfDiMsQtuC72_QvaOW9RGOTA8kn7uQkIZJZ1MZAapBPaWHtaHUw4ZxHYKXMP1ga8b2c-T6hV70Qk5k-OaBMweSR-NFttqfscTAbrcBgHODlMBBOScpWQJnArcc-Q8jX8Dn-V-35da8hxuVI Aug 17 08:48:46.335561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:48:46.335561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:48:46.335561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:48:46.335561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:48:46.335561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:48:46.335561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:48:46.335561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:48:46.335561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:46.335561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:48:46.335561 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:48:46.337856 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_34b106e46b2c4fb292353a6176c9f699", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:48:46.337856 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:46.337856 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:48:46.337856 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:46.337856 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:48:46.337856 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:48:46.337856 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:48:46.337856 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: 49114d25c04144269e3eb88448e2c2ee Aug 17 08:48:46.337856 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:48:46.337856 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: > Aug 17 08:48:46.337856 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Instance 43b85b50-c35a-4f5e-a5cc-c67859166b3c could not be found. Aug 17 08:48:46.337856 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': '43b85b50-c35a-4f5e-a5cc-c67859166b3c'} Aug 17 08:48:46.338757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:48:46.338757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:46.338757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:48:46.338757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:48:46.338757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:48:46.338757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:48:46.338757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:48:46.338757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:48:46.338757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:48:46.338757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:48:46.338757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43b85b50-c35a-4f5e-a5cc-c67859166b3c could not be found. Aug 17 08:48:46.338757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:46.338757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:46.338757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:46.338757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:46.338757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:46.338757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:46.338757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:48:46.338757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:48:46.338757 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:48:46.340345 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:48:46.340345 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 08:48:46.340345 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 08:48:46.340345 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 08:48:46.340345 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 08:48:46.340345 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:48:46.340345 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:48:46.340345 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:48:46.340345 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:48:46.340345 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43b85b50-c35a-4f5e-a5cc-c67859166b3c could not be found. Aug 17 08:48:46.340345 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:46.340345 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:46.340345 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:46.340345 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:46.340345 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:46.340345 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:46.340345 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:48:46.340345 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:48:46.340345 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43b85b50-c35a-4f5e-a5cc-c67859166b3c could not be found. Aug 17 08:48:46.340345 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:46.342255 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-378c296e-579a-41cb-9939-7809e028602d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Returning 404 to user: Instance 43b85b50-c35a-4f5e-a5cc-c67859166b3c could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:48:46.342255 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-378c296e-579a-41cb-9939-7809e028602d tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "DELETE /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c" status: 404 len: 111 microversion: 2.1 time: 0.030881 Aug 17 08:48:46.342255 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 458/902] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:48:46 2022] DELETE /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:48:46.346039 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d0dfcfd8-fcc8-4bf1-afe2-c5c96df2c1af tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:46.346636 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d0dfcfd8-fcc8-4bf1-afe2-c5c96df2c1af tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 43b85b50-c35a-4f5e-a5cc-c67859166b3c] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:46.352942 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d0dfcfd8-fcc8-4bf1-afe2-c5c96df2c1af tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:46.353443 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d0dfcfd8-fcc8-4bf1-afe2-c5c96df2c1af tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:46.353866 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d0dfcfd8-fcc8-4bf1-afe2-c5c96df2c1af tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:46.354537 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d0dfcfd8-fcc8-4bf1-afe2-c5c96df2c1af tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:46.354975 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d0dfcfd8-fcc8-4bf1-afe2-c5c96df2c1af tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:46.355384 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d0dfcfd8-fcc8-4bf1-afe2-c5c96df2c1af tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:46.368715 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-d0dfcfd8-fcc8-4bf1-afe2-c5c96df2c1af tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] HTTP exception thrown: Instance 43b85b50-c35a-4f5e-a5cc-c67859166b3c could not be found. Aug 17 08:48:46.370199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d0dfcfd8-fcc8-4bf1-afe2-c5c96df2c1af tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Request method failure captured: Aug 17 08:48:46.370199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c HTTP/1.1 Aug 17 08:48:46.370199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:48:46.370199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:48:46.370199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:48:46.370199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:48:46.370199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:48:46.370199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:48:46.370199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:48:46.370199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:48:46.370199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_KpFdcvpXRpf5-5Y1Bcdp25cETTaZP2GCfDiMsQtuC72_QvaOW9RGOTA8kn7uQkIZJZ1MZAapBPaWHtaHUw4ZxHYKXMP1ga8b2c-T6hV70Qk5k-OaBMweSR-NFttqfscTAbrcBgHODlMBBOScpWQJnArcc-Q8jX8Dn-V-35da8hxuVI Aug 17 08:48:46.370199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:48:46.370199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:48:46.370199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:48:46.370199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:48:46.370199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:48:46.370199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:48:46.370199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:48:46.370199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:46.370199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:48:46.370199 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:48:46.371987 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_34b106e46b2c4fb292353a6176c9f699", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:48:46.371987 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:46.371987 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:48:46.371987 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:46.371987 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:48:46.371987 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:48:46.371987 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:48:46.371987 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: 49114d25c04144269e3eb88448e2c2ee Aug 17 08:48:46.371987 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:48:46.371987 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:48:46.371987 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Instance 43b85b50-c35a-4f5e-a5cc-c67859166b3c could not be found. Aug 17 08:48:46.371987 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'id': '43b85b50-c35a-4f5e-a5cc-c67859166b3c'} Aug 17 08:48:46.372954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:48:46.372954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:46.372954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:48:46.372954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:48:46.372954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:48:46.372954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:48:46.372954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:48:46.372954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:48:46.372954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:48:46.372954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:48:46.372954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43b85b50-c35a-4f5e-a5cc-c67859166b3c could not be found. Aug 17 08:48:46.372954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:46.372954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:46.372954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:46.372954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:46.372954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:46.372954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:46.372954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:48:46.372954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:48:46.372954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:48:46.374529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:48:46.374529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:48:46.374529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:48:46.374529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:48:46.374529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:48:46.374529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:48:46.374529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:48:46.374529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43b85b50-c35a-4f5e-a5cc-c67859166b3c could not be found. Aug 17 08:48:46.374529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:46.374529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:46.374529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:46.374529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:46.374529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:46.374529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:46.374529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:48:46.374529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:48:46.374529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43b85b50-c35a-4f5e-a5cc-c67859166b3c could not be found. Aug 17 08:48:46.374529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:46.375955 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d0dfcfd8-fcc8-4bf1-afe2-c5c96df2c1af tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Returning 404 to user: Instance 43b85b50-c35a-4f5e-a5cc-c67859166b3c could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:48:46.375955 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d0dfcfd8-fcc8-4bf1-afe2-c5c96df2c1af tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c" status: 404 len: 111 microversion: 2.1 time: 0.029519 Aug 17 08:48:46.375955 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 445/903] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:48:46 2022] GET /compute/v2.1/servers/43b85b50-c35a-4f5e-a5cc-c67859166b3c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:48:46.380003 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8c85472f-dac8-4255-9344-6f8f7f51408f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:46.380492 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8c85472f-dac8-4255-9344-6f8f7f51408f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: db02d6b1-c272-4c1d-8700-3e096703b1d6] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:46.386880 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8c85472f-dac8-4255-9344-6f8f7f51408f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:46.387349 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8c85472f-dac8-4255-9344-6f8f7f51408f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:46.387805 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8c85472f-dac8-4255-9344-6f8f7f51408f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:46.388540 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8c85472f-dac8-4255-9344-6f8f7f51408f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:46.388985 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8c85472f-dac8-4255-9344-6f8f7f51408f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:46.389407 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8c85472f-dac8-4255-9344-6f8f7f51408f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:46.403038 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-8c85472f-dac8-4255-9344-6f8f7f51408f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] HTTP exception thrown: Instance db02d6b1-c272-4c1d-8700-3e096703b1d6 could not be found. Aug 17 08:48:46.404570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8c85472f-dac8-4255-9344-6f8f7f51408f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Request method failure captured: Aug 17 08:48:46.404570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: DELETE /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6 HTTP/1.1 Aug 17 08:48:46.404570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:48:46.404570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:48:46.404570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:48:46.404570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:48:46.404570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:48:46.404570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:48:46.404570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:48:46.404570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:48:46.404570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_KpFdcvpXRpf5-5Y1Bcdp25cETTaZP2GCfDiMsQtuC72_QvaOW9RGOTA8kn7uQkIZJZ1MZAapBPaWHtaHUw4ZxHYKXMP1ga8b2c-T6hV70Qk5k-OaBMweSR-NFttqfscTAbrcBgHODlMBBOScpWQJnArcc-Q8jX8Dn-V-35da8hxuVI Aug 17 08:48:46.404570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:48:46.404570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:48:46.404570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:48:46.404570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:48:46.404570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:48:46.404570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:48:46.404570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:48:46.404570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:46.404570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:48:46.404570 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:48:46.406218 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_34b106e46b2c4fb292353a6176c9f699", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:48:46.406218 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:46.406218 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:48:46.406218 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:46.406218 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:48:46.406218 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:48:46.406218 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:48:46.406218 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: 49114d25c04144269e3eb88448e2c2ee Aug 17 08:48:46.406218 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:48:46.406218 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: > Aug 17 08:48:46.406218 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Instance db02d6b1-c272-4c1d-8700-3e096703b1d6 could not be found. Aug 17 08:48:46.406218 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': 'db02d6b1-c272-4c1d-8700-3e096703b1d6'} Aug 17 08:48:46.407324 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:48:46.407324 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:46.407324 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:48:46.407324 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:48:46.407324 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:48:46.407324 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:48:46.407324 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:48:46.407324 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:48:46.407324 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:48:46.407324 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:48:46.407324 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db02d6b1-c272-4c1d-8700-3e096703b1d6 could not be found. Aug 17 08:48:46.407324 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:46.407324 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:46.407324 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:46.407324 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:46.407324 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:46.407324 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:46.407324 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:48:46.407324 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:48:46.407324 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:48:46.408882 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:48:46.408882 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 08:48:46.408882 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 08:48:46.408882 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 08:48:46.408882 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 08:48:46.408882 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:48:46.408882 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:48:46.408882 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:48:46.408882 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:48:46.408882 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db02d6b1-c272-4c1d-8700-3e096703b1d6 could not be found. Aug 17 08:48:46.408882 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:46.408882 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:46.408882 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:46.408882 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:46.408882 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:46.408882 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:46.408882 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:48:46.408882 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:48:46.408882 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db02d6b1-c272-4c1d-8700-3e096703b1d6 could not be found. Aug 17 08:48:46.408882 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:46.410735 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8c85472f-dac8-4255-9344-6f8f7f51408f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Returning 404 to user: Instance db02d6b1-c272-4c1d-8700-3e096703b1d6 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:48:46.410735 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8c85472f-dac8-4255-9344-6f8f7f51408f tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "DELETE /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6" status: 404 len: 111 microversion: 2.1 time: 0.029838 Aug 17 08:48:46.410735 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 459/904] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:48:46 2022] DELETE /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:48:46.414229 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-70c66426-fe9d-4d7c-b24e-163eeea592a4 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:46.414839 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-70c66426-fe9d-4d7c-b24e-163eeea592a4 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: db02d6b1-c272-4c1d-8700-3e096703b1d6] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:46.420907 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-70c66426-fe9d-4d7c-b24e-163eeea592a4 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:46.421384 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-70c66426-fe9d-4d7c-b24e-163eeea592a4 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:46.421821 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-70c66426-fe9d-4d7c-b24e-163eeea592a4 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:46.422500 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-70c66426-fe9d-4d7c-b24e-163eeea592a4 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:46.422946 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-70c66426-fe9d-4d7c-b24e-163eeea592a4 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:46.423365 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-70c66426-fe9d-4d7c-b24e-163eeea592a4 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:46.436431 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-70c66426-fe9d-4d7c-b24e-163eeea592a4 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] HTTP exception thrown: Instance db02d6b1-c272-4c1d-8700-3e096703b1d6 could not be found. Aug 17 08:48:46.437944 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-70c66426-fe9d-4d7c-b24e-163eeea592a4 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Request method failure captured: Aug 17 08:48:46.437944 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6 HTTP/1.1 Aug 17 08:48:46.437944 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:48:46.437944 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:48:46.437944 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:48:46.437944 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:48:46.437944 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:48:46.437944 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:48:46.437944 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:48:46.437944 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:48:46.437944 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_KpFdcvpXRpf5-5Y1Bcdp25cETTaZP2GCfDiMsQtuC72_QvaOW9RGOTA8kn7uQkIZJZ1MZAapBPaWHtaHUw4ZxHYKXMP1ga8b2c-T6hV70Qk5k-OaBMweSR-NFttqfscTAbrcBgHODlMBBOScpWQJnArcc-Q8jX8Dn-V-35da8hxuVI Aug 17 08:48:46.437944 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:48:46.437944 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:48:46.437944 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:48:46.437944 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:48:46.437944 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:48:46.437944 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:48:46.437944 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:48:46.437944 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:46.437944 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:48:46.437944 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:48:46.439584 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_34b106e46b2c4fb292353a6176c9f699", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:48:46.439584 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:46.439584 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:48:46.439584 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:46.439584 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:48:46.439584 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:48:46.439584 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:48:46.439584 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: 49114d25c04144269e3eb88448e2c2ee Aug 17 08:48:46.439584 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:48:46.439584 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:48:46.439584 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Instance db02d6b1-c272-4c1d-8700-3e096703b1d6 could not be found. Aug 17 08:48:46.439584 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'id': 'db02d6b1-c272-4c1d-8700-3e096703b1d6'} Aug 17 08:48:46.440723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:48:46.440723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:46.440723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:48:46.440723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:48:46.440723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:48:46.440723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:48:46.440723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:48:46.440723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:48:46.440723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:48:46.440723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:48:46.440723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db02d6b1-c272-4c1d-8700-3e096703b1d6 could not be found. Aug 17 08:48:46.440723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:46.440723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:46.440723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:46.440723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:46.440723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:46.440723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:46.440723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:48:46.440723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:48:46.440723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:48:46.442579 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:48:46.442579 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:48:46.442579 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:48:46.442579 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:48:46.442579 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:48:46.442579 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:48:46.442579 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:48:46.442579 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db02d6b1-c272-4c1d-8700-3e096703b1d6 could not be found. Aug 17 08:48:46.442579 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:46.442579 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:46.442579 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:46.442579 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:46.442579 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:46.442579 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:46.442579 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:48:46.442579 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:48:46.442579 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db02d6b1-c272-4c1d-8700-3e096703b1d6 could not be found. Aug 17 08:48:46.442579 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:46.443970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-70c66426-fe9d-4d7c-b24e-163eeea592a4 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Returning 404 to user: Instance db02d6b1-c272-4c1d-8700-3e096703b1d6 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:48:46.443970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-70c66426-fe9d-4d7c-b24e-163eeea592a4 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6" status: 404 len: 111 microversion: 2.1 time: 0.028935 Aug 17 08:48:46.443970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 446/905] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:48:46 2022] GET /compute/v2.1/servers/db02d6b1-c272-4c1d-8700-3e096703b1d6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:48:47.580799 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-306a8cf0-34f6-4bf5-82e3-bda46e15c6d9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:47.581287 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-306a8cf0-34f6-4bf5-82e3-bda46e15c6d9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:47.587685 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-306a8cf0-34f6-4bf5-82e3-bda46e15c6d9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:47.588158 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-306a8cf0-34f6-4bf5-82e3-bda46e15c6d9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:47.588588 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-306a8cf0-34f6-4bf5-82e3-bda46e15c6d9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:47.589264 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-306a8cf0-34f6-4bf5-82e3-bda46e15c6d9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:47.589710 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-306a8cf0-34f6-4bf5-82e3-bda46e15c6d9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:47.590128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-306a8cf0-34f6-4bf5-82e3-bda46e15c6d9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:47.603759 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-306a8cf0-34f6-4bf5-82e3-bda46e15c6d9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] HTTP exception thrown: Instance 3e566e58-543c-4264-bee0-185da5050972 could not be found. Aug 17 08:48:47.605464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-306a8cf0-34f6-4bf5-82e3-bda46e15c6d9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Request method failure captured: Aug 17 08:48:47.605464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: DELETE /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972 HTTP/1.1 Aug 17 08:48:47.605464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:48:47.605464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:48:47.605464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:48:47.605464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:48:47.605464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:48:47.605464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:48:47.605464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:48:47.605464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:48:47.605464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_KpFdcvpXRpf5-5Y1Bcdp25cETTaZP2GCfDiMsQtuC72_QvaOW9RGOTA8kn7uQkIZJZ1MZAapBPaWHtaHUw4ZxHYKXMP1ga8b2c-T6hV70Qk5k-OaBMweSR-NFttqfscTAbrcBgHODlMBBOScpWQJnArcc-Q8jX8Dn-V-35da8hxuVI Aug 17 08:48:47.605464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:48:47.605464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:48:47.605464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:48:47.605464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:48:47.605464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:48:47.605464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:48:47.605464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:48:47.605464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:47.605464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:48:47.605464 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:48:47.606895 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_34b106e46b2c4fb292353a6176c9f699", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:48:47.606895 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:47.606895 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:48:47.606895 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:47.606895 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:48:47.606895 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:48:47.606895 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:48:47.606895 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: 49114d25c04144269e3eb88448e2c2ee Aug 17 08:48:47.606895 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:48:47.606895 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: > Aug 17 08:48:47.606895 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Instance 3e566e58-543c-4264-bee0-185da5050972 could not be found. Aug 17 08:48:47.606895 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': '3e566e58-543c-4264-bee0-185da5050972'} Aug 17 08:48:47.608128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:48:47.608128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:47.608128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:48:47.608128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:48:47.608128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:48:47.608128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:48:47.608128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:48:47.608128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:48:47.608128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:48:47.608128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:48:47.608128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e566e58-543c-4264-bee0-185da5050972 could not be found. Aug 17 08:48:47.608128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:47.608128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:47.608128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:47.608128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:47.608128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:47.608128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:47.608128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:48:47.608128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:48:47.608128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:48:47.609506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:48:47.609506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 08:48:47.609506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 08:48:47.609506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 08:48:47.609506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 08:48:47.609506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:48:47.609506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:48:47.609506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:48:47.609506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:48:47.609506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e566e58-543c-4264-bee0-185da5050972 could not be found. Aug 17 08:48:47.609506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:47.609506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:47.609506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:47.609506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:47.609506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:47.609506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:47.609506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:48:47.609506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:48:47.609506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e566e58-543c-4264-bee0-185da5050972 could not be found. Aug 17 08:48:47.609506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:48:47.611371 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-306a8cf0-34f6-4bf5-82e3-bda46e15c6d9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Returning 404 to user: Instance 3e566e58-543c-4264-bee0-185da5050972 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:48:47.611371 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-306a8cf0-34f6-4bf5-82e3-bda46e15c6d9 tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972" status: 404 len: 111 microversion: 2.1 time: 0.029851 Aug 17 08:48:47.611371 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 460/906] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:48:47 2022] DELETE /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:48:47.615278 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c65946cf-996a-483a-8aa4-b939ad81cb6e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:47.615906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-c65946cf-996a-483a-8aa4-b939ad81cb6e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] [instance: 3e566e58-543c-4264-bee0-185da5050972] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:47.622434 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c65946cf-996a-483a-8aa4-b939ad81cb6e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:47.622903 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c65946cf-996a-483a-8aa4-b939ad81cb6e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:47.623339 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c65946cf-996a-483a-8aa4-b939ad81cb6e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:47.624027 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c65946cf-996a-483a-8aa4-b939ad81cb6e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:47.624469 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c65946cf-996a-483a-8aa4-b939ad81cb6e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:47.624878 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-c65946cf-996a-483a-8aa4-b939ad81cb6e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:47.638469 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-c65946cf-996a-483a-8aa4-b939ad81cb6e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] HTTP exception thrown: Instance 3e566e58-543c-4264-bee0-185da5050972 could not be found. Aug 17 08:48:47.640010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c65946cf-996a-483a-8aa4-b939ad81cb6e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Request method failure captured: Aug 17 08:48:47.640010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972 HTTP/1.1 Aug 17 08:48:47.640010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:48:47.640010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:48:47.640010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:48:47.640010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:48:47.640010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:48:47.640010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:48:47.640010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:48:47.640010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:48:47.640010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_KpFdcvpXRpf5-5Y1Bcdp25cETTaZP2GCfDiMsQtuC72_QvaOW9RGOTA8kn7uQkIZJZ1MZAapBPaWHtaHUw4ZxHYKXMP1ga8b2c-T6hV70Qk5k-OaBMweSR-NFttqfscTAbrcBgHODlMBBOScpWQJnArcc-Q8jX8Dn-V-35da8hxuVI Aug 17 08:48:47.640010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:48:47.640010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:48:47.640010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:48:47.640010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:48:47.640010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:48:47.640010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:48:47.640010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:48:47.640010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:47.640010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:48:47.640010 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:48:47.641714 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/34b106e46b2c4fb292353a6176c9f699"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_34b106e46b2c4fb292353a6176c9f699", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:48:47.641714 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:47.641714 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 34b106e46b2c4fb292353a6176c9f699 Aug 17 08:48:47.641714 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1454936400 Aug 17 08:48:47.641714 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:48:47.641714 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:48:47.641714 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:48:47.641714 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: 49114d25c04144269e3eb88448e2c2ee Aug 17 08:48:47.641714 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-AttachVolumeNegativeTest-1454936400-project Aug 17 08:48:47.641714 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:48:47.641714 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Instance 3e566e58-543c-4264-bee0-185da5050972 could not be found. Aug 17 08:48:47.641714 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'id': '3e566e58-543c-4264-bee0-185da5050972'} Aug 17 08:48:47.642642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:48:47.642642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:47.642642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:48:47.642642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:48:47.642642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:48:47.642642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:48:47.642642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:48:47.642642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:48:47.642642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:48:47.642642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:48:47.642642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e566e58-543c-4264-bee0-185da5050972 could not be found. Aug 17 08:48:47.642642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:47.642642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:47.642642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:47.642642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:47.642642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:47.642642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:47.642642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:48:47.642642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:48:47.642642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:48:47.643981 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:48:47.643981 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:48:47.643981 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:48:47.643981 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:48:47.643981 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:48:47.643981 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:48:47.643981 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:48:47.643981 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e566e58-543c-4264-bee0-185da5050972 could not be found. Aug 17 08:48:47.643981 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:47.643981 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:48:47.643981 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:47.643981 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:48:47.643981 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:48:47.643981 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:48:47.643981 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:48:47.643981 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:48:47.643981 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e566e58-543c-4264-bee0-185da5050972 could not be found. Aug 17 08:48:47.643981 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:48:47.645167 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-c65946cf-996a-483a-8aa4-b939ad81cb6e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] Returning 404 to user: Instance 3e566e58-543c-4264-bee0-185da5050972 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:48:47.645167 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-c65946cf-996a-483a-8aa4-b939ad81cb6e tempest-AttachVolumeNegativeTest-1454936400 tempest-AttachVolumeNegativeTest-1454936400-project] 10.222.0.15 "GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972" status: 404 len: 111 microversion: 2.1 time: 0.029762 Aug 17 08:48:47.645167 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 447/907] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:48:47 2022] GET /compute/v2.1/servers/3e566e58-543c-4264-bee0-185da5050972 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:48:58.531466 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3eb0a5fb-c994-46d9-aad0-e02c244e95bf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-770918686", "imageRef": "4467450c-a35c-42e3-af85-a13291b0b2aa", "flavorRef": "452", "networks": [{"uuid": "f49d00c8-24ee-4d4a-8e2f-3616d765dd6c"}]}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:48:58.540678 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=18 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:58.541495 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:58.591300 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.network.neutron [None req-3eb0a5fb-c994-46d9-aad0-e02c244e95bf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] validate_networks() for [('f49d00c8-24ee-4d4a-8e2f-3616d765dd6c', None, None, None, None, None)] {{(pid=127297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 08:48:59.048634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-3eb0a5fb-c994-46d9-aad0-e02c244e95bf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Flavor limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 08:48:59.049168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-3eb0a5fb-c994-46d9-aad0-e02c244e95bf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Image limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 08:48:59.049717 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-3eb0a5fb-c994-46d9-aad0-e02c244e95bf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Flavor pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 08:48:59.050124 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-3eb0a5fb-c994-46d9-aad0-e02c244e95bf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Image pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 08:48:59.050525 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-3eb0a5fb-c994-46d9-aad0-e02c244e95bf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 08:48:59.059281 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3eb0a5fb-c994-46d9-aad0-e02c244e95bf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:59.059785 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3eb0a5fb-c994-46d9-aad0-e02c244e95bf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:59.060210 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3eb0a5fb-c994-46d9-aad0-e02c244e95bf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:59.060933 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3eb0a5fb-c994-46d9-aad0-e02c244e95bf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:48:59.061439 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3eb0a5fb-c994-46d9-aad0-e02c244e95bf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:48:59.061852 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3eb0a5fb-c994-46d9-aad0-e02c244e95bf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:48:59.078902 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-3eb0a5fb-c994-46d9-aad0-e02c244e95bf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Getting quotas for project 79af4e4c37954eccba4385577ce68dcd. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:48:59.082795 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-3eb0a5fb-c994-46d9-aad0-e02c244e95bf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Getting quotas for user 3e33d51101b14589a7e440be6fdbb20d and project 79af4e4c37954eccba4385577ce68dcd. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:48:59.095741 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3eb0a5fb-c994-46d9-aad0-e02c244e95bf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Going to run 1 instances... {{(pid=127297) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 08:48:59.098188 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3eb0a5fb-c994-46d9-aad0-e02c244e95bf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: 80c263df-2026-4155-8e87-c387c665c799] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4467450c-a35c-42e3-af85-a13291b0b2aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 08:48:59.142601 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3eb0a5fb-c994-46d9-aad0-e02c244e95bf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614997 Aug 17 08:48:59.143440 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 461/908] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 08:48:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 08:48:59.155724 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-a1f40b33-5ecd-4716-8e42-005074fc6276 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:48:59.156469 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-a1f40b33-5ecd-4716-8e42-005074fc6276 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: 80c263df-2026-4155-8e87-c387c665c799] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:48:59.162426 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:59.163753 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:48:59.230127 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-a1f40b33-5ecd-4716-8e42-005074fc6276 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:48:59.237235 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-a1f40b33-5ecd-4716-8e42-005074fc6276 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799" status: 200 len: 1213 microversion: 2.1 time: 0.086437 Aug 17 08:48:59.237997 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 448/909] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:48:59 2022] GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:49:00.259270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8abdfd01-6219-4ad9-bc59-5ab575eb70e6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:00.260483 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8abdfd01-6219-4ad9-bc59-5ab575eb70e6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: 80c263df-2026-4155-8e87-c387c665c799] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:00.269827 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8abdfd01-6219-4ad9-bc59-5ab575eb70e6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:00.270325 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8abdfd01-6219-4ad9-bc59-5ab575eb70e6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:00.270762 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8abdfd01-6219-4ad9-bc59-5ab575eb70e6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:00.271465 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8abdfd01-6219-4ad9-bc59-5ab575eb70e6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:00.272001 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8abdfd01-6219-4ad9-bc59-5ab575eb70e6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:00.272430 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8abdfd01-6219-4ad9-bc59-5ab575eb70e6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:00.362116 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8abdfd01-6219-4ad9-bc59-5ab575eb70e6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:00.370306 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8abdfd01-6219-4ad9-bc59-5ab575eb70e6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799" status: 200 len: 1273 microversion: 2.1 time: 0.115744 Aug 17 08:49:00.375749 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 462/910] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:00 2022] GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799 => generated 1273 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:49:01.390871 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-088638f4-2c00-4c9b-b8dc-0b920682f515 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:01.391472 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-088638f4-2c00-4c9b-b8dc-0b920682f515 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: 80c263df-2026-4155-8e87-c387c665c799] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:01.401519 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-088638f4-2c00-4c9b-b8dc-0b920682f515 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:01.402007 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-088638f4-2c00-4c9b-b8dc-0b920682f515 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:01.402433 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-088638f4-2c00-4c9b-b8dc-0b920682f515 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:01.403114 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-088638f4-2c00-4c9b-b8dc-0b920682f515 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:01.403574 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-088638f4-2c00-4c9b-b8dc-0b920682f515 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:01.404011 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-088638f4-2c00-4c9b-b8dc-0b920682f515 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:01.600020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-088638f4-2c00-4c9b-b8dc-0b920682f515 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:01.618872 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-088638f4-2c00-4c9b-b8dc-0b920682f515 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799" status: 200 len: 1313 microversion: 2.1 time: 0.227290 Aug 17 08:49:01.618872 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 449/911] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:01 2022] GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:49:01.661650 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-10b0f050-4654-47b6-9fdb-a3bc66c9bc96 req-7d6fdcee-56c4-410f-a8e5-3afd7eef89ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80c263df-2026-4155-8e87-c387c665c799", "tag": "114568e5-2426-43f0-9584-a6c518e9a269"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:49:01.672692 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-10b0f050-4654-47b6-9fdb-a3bc66c9bc96 req-7d6fdcee-56c4-410f-a8e5-3afd7eef89ad service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:01.673169 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-10b0f050-4654-47b6-9fdb-a3bc66c9bc96 req-7d6fdcee-56c4-410f-a8e5-3afd7eef89ad service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:01.673597 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-10b0f050-4654-47b6-9fdb-a3bc66c9bc96 req-7d6fdcee-56c4-410f-a8e5-3afd7eef89ad service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:01.686328 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-10b0f050-4654-47b6-9fdb-a3bc66c9bc96 req-7d6fdcee-56c4-410f-a8e5-3afd7eef89ad service nova] Creating event network-changed:114568e5-2426-43f0-9584-a6c518e9a269 for instance 80c263df-2026-4155-8e87-c387c665c799 on hv-cinder-85331 Aug 17 08:49:01.691363 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-10b0f050-4654-47b6-9fdb-a3bc66c9bc96 req-7d6fdcee-56c4-410f-a8e5-3afd7eef89ad service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033679 Aug 17 08:49:01.692347 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 463/912] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:49:02.636022 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6f7d36df-06e0-488b-8cc6-870e62a51c78 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:02.636621 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6f7d36df-06e0-488b-8cc6-870e62a51c78 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: 80c263df-2026-4155-8e87-c387c665c799] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:02.642892 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6f7d36df-06e0-488b-8cc6-870e62a51c78 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:02.643364 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6f7d36df-06e0-488b-8cc6-870e62a51c78 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:02.643826 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6f7d36df-06e0-488b-8cc6-870e62a51c78 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:02.644491 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6f7d36df-06e0-488b-8cc6-870e62a51c78 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:02.644931 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6f7d36df-06e0-488b-8cc6-870e62a51c78 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:02.645340 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6f7d36df-06e0-488b-8cc6-870e62a51c78 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:02.773931 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6f7d36df-06e0-488b-8cc6-870e62a51c78 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:02.787831 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6f7d36df-06e0-488b-8cc6-870e62a51c78 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799" status: 200 len: 1313 microversion: 2.1 time: 0.150156 Aug 17 08:49:02.787831 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 450/913] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:02 2022] GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:49:03.805204 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-08acb384-0f02-4090-a188-ea7d3ee02404 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:03.806006 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-08acb384-0f02-4090-a188-ea7d3ee02404 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: 80c263df-2026-4155-8e87-c387c665c799] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:03.813650 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-08acb384-0f02-4090-a188-ea7d3ee02404 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:03.814136 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-08acb384-0f02-4090-a188-ea7d3ee02404 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:03.814599 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-08acb384-0f02-4090-a188-ea7d3ee02404 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:03.815440 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-08acb384-0f02-4090-a188-ea7d3ee02404 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:03.815877 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-08acb384-0f02-4090-a188-ea7d3ee02404 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:03.816357 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-08acb384-0f02-4090-a188-ea7d3ee02404 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:04.175468 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-08acb384-0f02-4090-a188-ea7d3ee02404 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:04.183054 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-08acb384-0f02-4090-a188-ea7d3ee02404 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799" status: 200 len: 1313 microversion: 2.1 time: 0.384562 Aug 17 08:49:04.195771 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 464/914] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:03 2022] GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799 => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:49:05.203910 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-176110e0-0b35-4356-90ec-a49b1c300f95 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:05.204512 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-176110e0-0b35-4356-90ec-a49b1c300f95 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: 80c263df-2026-4155-8e87-c387c665c799] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:05.213291 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-176110e0-0b35-4356-90ec-a49b1c300f95 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:05.213594 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-176110e0-0b35-4356-90ec-a49b1c300f95 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:05.214127 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-176110e0-0b35-4356-90ec-a49b1c300f95 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:05.214943 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-176110e0-0b35-4356-90ec-a49b1c300f95 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:05.215496 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-176110e0-0b35-4356-90ec-a49b1c300f95 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:05.216086 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-176110e0-0b35-4356-90ec-a49b1c300f95 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:05.347821 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-176110e0-0b35-4356-90ec-a49b1c300f95 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:05.355425 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-176110e0-0b35-4356-90ec-a49b1c300f95 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799" status: 200 len: 1313 microversion: 2.1 time: 0.155346 Aug 17 08:49:05.356123 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 451/915] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:05 2022] GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:49:06.376500 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-612da511-0bbc-48f7-9ba5-ff4913ea8856 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:06.377043 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-612da511-0bbc-48f7-9ba5-ff4913ea8856 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: 80c263df-2026-4155-8e87-c387c665c799] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:06.383977 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-612da511-0bbc-48f7-9ba5-ff4913ea8856 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:06.384453 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-612da511-0bbc-48f7-9ba5-ff4913ea8856 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:06.384877 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-612da511-0bbc-48f7-9ba5-ff4913ea8856 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:06.385551 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-612da511-0bbc-48f7-9ba5-ff4913ea8856 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:06.385995 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-612da511-0bbc-48f7-9ba5-ff4913ea8856 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:06.386404 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-612da511-0bbc-48f7-9ba5-ff4913ea8856 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:06.511906 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-612da511-0bbc-48f7-9ba5-ff4913ea8856 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:06.519207 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-612da511-0bbc-48f7-9ba5-ff4913ea8856 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799" status: 200 len: 1313 microversion: 2.1 time: 0.146613 Aug 17 08:49:06.519798 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 465/916] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:06 2022] GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:49:07.509127 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-a7dee897-0a48-42b2-a4ab-36de51cc3b2d req-2a49044f-7f5d-4df2-8f4e-a34ff94f325d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80c263df-2026-4155-8e87-c387c665c799", "name": "network-vif-plugged", "status": "completed", "tag": "114568e5-2426-43f0-9584-a6c518e9a269"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:49:07.518683 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-a7dee897-0a48-42b2-a4ab-36de51cc3b2d req-2a49044f-7f5d-4df2-8f4e-a34ff94f325d service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:07.519156 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-a7dee897-0a48-42b2-a4ab-36de51cc3b2d req-2a49044f-7f5d-4df2-8f4e-a34ff94f325d service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:07.519596 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-a7dee897-0a48-42b2-a4ab-36de51cc3b2d req-2a49044f-7f5d-4df2-8f4e-a34ff94f325d service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:07.530639 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-a7dee897-0a48-42b2-a4ab-36de51cc3b2d req-2a49044f-7f5d-4df2-8f4e-a34ff94f325d service nova] Creating event network-vif-plugged:114568e5-2426-43f0-9584-a6c518e9a269 for instance 80c263df-2026-4155-8e87-c387c665c799 on hv-cinder-85331 Aug 17 08:49:07.535818 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-a7dee897-0a48-42b2-a4ab-36de51cc3b2d req-2a49044f-7f5d-4df2-8f4e-a34ff94f325d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151266 Aug 17 08:49:07.536413 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 452/917] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:49:07.538903 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a5fe95ec-9357-43ec-a058-b8c83891d388 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:07.539507 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a5fe95ec-9357-43ec-a058-b8c83891d388 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: 80c263df-2026-4155-8e87-c387c665c799] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:07.545820 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a5fe95ec-9357-43ec-a058-b8c83891d388 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:07.546293 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a5fe95ec-9357-43ec-a058-b8c83891d388 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:07.546718 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a5fe95ec-9357-43ec-a058-b8c83891d388 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:07.547394 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a5fe95ec-9357-43ec-a058-b8c83891d388 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:07.547866 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a5fe95ec-9357-43ec-a058-b8c83891d388 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:07.548280 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a5fe95ec-9357-43ec-a058-b8c83891d388 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:07.684397 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a5fe95ec-9357-43ec-a058-b8c83891d388 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:07.693034 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a5fe95ec-9357-43ec-a058-b8c83891d388 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799" status: 200 len: 1313 microversion: 2.1 time: 0.158022 Aug 17 08:49:07.693832 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 466/918] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:07 2022] GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:49:08.715781 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1e79fb5f-c8c9-4fdc-b1c8-008be992eb92 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:08.716471 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1e79fb5f-c8c9-4fdc-b1c8-008be992eb92 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: 80c263df-2026-4155-8e87-c387c665c799] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:08.722582 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1e79fb5f-c8c9-4fdc-b1c8-008be992eb92 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:08.723054 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1e79fb5f-c8c9-4fdc-b1c8-008be992eb92 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:08.723481 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1e79fb5f-c8c9-4fdc-b1c8-008be992eb92 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:08.724244 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1e79fb5f-c8c9-4fdc-b1c8-008be992eb92 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:08.724991 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1e79fb5f-c8c9-4fdc-b1c8-008be992eb92 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:08.725506 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1e79fb5f-c8c9-4fdc-b1c8-008be992eb92 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:08.856862 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1e79fb5f-c8c9-4fdc-b1c8-008be992eb92 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:08.864249 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1e79fb5f-c8c9-4fdc-b1c8-008be992eb92 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799" status: 200 len: 1313 microversion: 2.1 time: 0.153883 Aug 17 08:49:08.864733 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 453/919] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:08 2022] GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:49:09.884634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-9b44eaf1-b2ce-4d75-a0d7-77431b878dc6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:09.885319 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-9b44eaf1-b2ce-4d75-a0d7-77431b878dc6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: 80c263df-2026-4155-8e87-c387c665c799] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:09.887784 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:09.888535 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=6 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:09.893714 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9b44eaf1-b2ce-4d75-a0d7-77431b878dc6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:09.894200 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9b44eaf1-b2ce-4d75-a0d7-77431b878dc6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:09.894634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9b44eaf1-b2ce-4d75-a0d7-77431b878dc6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:09.895354 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9b44eaf1-b2ce-4d75-a0d7-77431b878dc6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:09.895829 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9b44eaf1-b2ce-4d75-a0d7-77431b878dc6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:09.896251 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-9b44eaf1-b2ce-4d75-a0d7-77431b878dc6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:10.073854 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-9b44eaf1-b2ce-4d75-a0d7-77431b878dc6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:10.089164 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-9b44eaf1-b2ce-4d75-a0d7-77431b878dc6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799" status: 200 len: 1497 microversion: 2.1 time: 0.208320 Aug 17 08:49:10.089745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 467/920] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:09 2022] GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799 => generated 1497 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:49:10.571100 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6d05c7df-b0c5-4a88-8045-9a9122f61111 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:10.571760 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6d05c7df-b0c5-4a88-8045-9a9122f61111 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: 80c263df-2026-4155-8e87-c387c665c799] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:10.574609 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:10.580531 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6d05c7df-b0c5-4a88-8045-9a9122f61111 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:10.581096 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6d05c7df-b0c5-4a88-8045-9a9122f61111 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:10.581533 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6d05c7df-b0c5-4a88-8045-9a9122f61111 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:10.582261 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6d05c7df-b0c5-4a88-8045-9a9122f61111 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:10.582708 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6d05c7df-b0c5-4a88-8045-9a9122f61111 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:10.583220 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6d05c7df-b0c5-4a88-8045-9a9122f61111 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:10.609880 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6d05c7df-b0c5-4a88-8045-9a9122f61111 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: 80c263df-2026-4155-8e87-c387c665c799] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 08:49:10.691292 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6d05c7df-b0c5-4a88-8045-9a9122f61111 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "DELETE /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799" status: 204 len: 0 microversion: 2.1 time: 0.124552 Aug 17 08:49:10.692222 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 454/921] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:49:10 2022] DELETE /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 08:49:10.701340 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4b63323d-81ad-4048-b2fd-b4463789b39d tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:10.701943 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-4b63323d-81ad-4048-b2fd-b4463789b39d tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: 80c263df-2026-4155-8e87-c387c665c799] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:10.707829 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4b63323d-81ad-4048-b2fd-b4463789b39d tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:10.708300 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4b63323d-81ad-4048-b2fd-b4463789b39d tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:10.708736 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4b63323d-81ad-4048-b2fd-b4463789b39d tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:10.709413 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4b63323d-81ad-4048-b2fd-b4463789b39d tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:10.709858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4b63323d-81ad-4048-b2fd-b4463789b39d tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:10.710270 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4b63323d-81ad-4048-b2fd-b4463789b39d tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:10.843836 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-4b63323d-81ad-4048-b2fd-b4463789b39d tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:10.851496 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4b63323d-81ad-4048-b2fd-b4463789b39d tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799" status: 200 len: 1503 microversion: 2.1 time: 0.154321 Aug 17 08:49:10.852077 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 468/922] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:10 2022] GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:49:11.872840 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-ae6eb767-9acf-48ae-9677-afa78f1eed13 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:11.873538 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-ae6eb767-9acf-48ae-9677-afa78f1eed13 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: 80c263df-2026-4155-8e87-c387c665c799] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:11.879964 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ae6eb767-9acf-48ae-9677-afa78f1eed13 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:11.880445 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ae6eb767-9acf-48ae-9677-afa78f1eed13 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:11.880878 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ae6eb767-9acf-48ae-9677-afa78f1eed13 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:11.881672 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ae6eb767-9acf-48ae-9677-afa78f1eed13 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:11.882065 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ae6eb767-9acf-48ae-9677-afa78f1eed13 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:11.883107 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-ae6eb767-9acf-48ae-9677-afa78f1eed13 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:12.020878 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-ae6eb767-9acf-48ae-9677-afa78f1eed13 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:12.028802 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-ae6eb767-9acf-48ae-9677-afa78f1eed13 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799" status: 200 len: 1503 microversion: 2.1 time: 0.160385 Aug 17 08:49:12.029453 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 455/923] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:11 2022] GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:49:13.024103 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-dc5a59cf-cc72-4a05-8120-a2dd4f56065b req-cca775c9-dac6-4f59-a294-e02a3148a049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80c263df-2026-4155-8e87-c387c665c799", "name": "network-vif-deleted", "tag": "114568e5-2426-43f0-9584-a6c518e9a269"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:49:13.033592 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-dc5a59cf-cc72-4a05-8120-a2dd4f56065b req-cca775c9-dac6-4f59-a294-e02a3148a049 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:13.034093 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-dc5a59cf-cc72-4a05-8120-a2dd4f56065b req-cca775c9-dac6-4f59-a294-e02a3148a049 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:13.034520 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-dc5a59cf-cc72-4a05-8120-a2dd4f56065b req-cca775c9-dac6-4f59-a294-e02a3148a049 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:13.048009 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-dc5a59cf-cc72-4a05-8120-a2dd4f56065b req-cca775c9-dac6-4f59-a294-e02a3148a049 service nova] Creating event network-vif-deleted:114568e5-2426-43f0-9584-a6c518e9a269 for instance 80c263df-2026-4155-8e87-c387c665c799 on hv-cinder-85331 Aug 17 08:49:13.050349 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6a5998e0-baf7-4eb6-8644-fa92fdaf2549 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:13.050974 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6a5998e0-baf7-4eb6-8644-fa92fdaf2549 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: 80c263df-2026-4155-8e87-c387c665c799] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:13.052992 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-dc5a59cf-cc72-4a05-8120-a2dd4f56065b req-cca775c9-dac6-4f59-a294-e02a3148a049 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167605 Aug 17 08:49:13.053573 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 469/924] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:49:13.057414 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6a5998e0-baf7-4eb6-8644-fa92fdaf2549 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:13.057895 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6a5998e0-baf7-4eb6-8644-fa92fdaf2549 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:13.058333 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6a5998e0-baf7-4eb6-8644-fa92fdaf2549 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:13.059016 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6a5998e0-baf7-4eb6-8644-fa92fdaf2549 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:13.059463 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6a5998e0-baf7-4eb6-8644-fa92fdaf2549 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:13.059904 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6a5998e0-baf7-4eb6-8644-fa92fdaf2549 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:13.090296 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6a5998e0-baf7-4eb6-8644-fa92fdaf2549 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:13.090774 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6a5998e0-baf7-4eb6-8644-fa92fdaf2549 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:13.091206 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6a5998e0-baf7-4eb6-8644-fa92fdaf2549 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:13.091727 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-6a5998e0-baf7-4eb6-8644-fa92fdaf2549 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lazy-loading 'fault' on Instance uuid 80c263df-2026-4155-8e87-c387c665c799 {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:49:13.133062 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-6a5998e0-baf7-4eb6-8644-fa92fdaf2549 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:13.140428 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6a5998e0-baf7-4eb6-8644-fa92fdaf2549 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799" status: 200 len: 1303 microversion: 2.1 time: 0.094011 Aug 17 08:49:13.140982 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 456/925] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:13 2022] GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799 => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:49:14.165559 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-14966d2f-bf7e-4abb-a217-cf33dbae9291 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:14.166250 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-14966d2f-bf7e-4abb-a217-cf33dbae9291 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: 80c263df-2026-4155-8e87-c387c665c799] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:14.172933 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14966d2f-bf7e-4abb-a217-cf33dbae9291 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:14.173408 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14966d2f-bf7e-4abb-a217-cf33dbae9291 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:14.173840 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14966d2f-bf7e-4abb-a217-cf33dbae9291 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:14.174518 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14966d2f-bf7e-4abb-a217-cf33dbae9291 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:14.174967 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14966d2f-bf7e-4abb-a217-cf33dbae9291 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:14.175387 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-14966d2f-bf7e-4abb-a217-cf33dbae9291 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:14.189398 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-14966d2f-bf7e-4abb-a217-cf33dbae9291 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] HTTP exception thrown: Instance 80c263df-2026-4155-8e87-c387c665c799 could not be found. Aug 17 08:49:14.190997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-14966d2f-bf7e-4abb-a217-cf33dbae9291 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Request method failure captured: Aug 17 08:49:14.190997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799 HTTP/1.1 Aug 17 08:49:14.190997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:49:14.190997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:49:14.190997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:49:14.190997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:49:14.190997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:49:14.190997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:49:14.190997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:49:14.190997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:49:14.190997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_Kt4M91g38Q3NpaiiQ4x9jbrh3H4T5XRE5NT4Ld6pQ6TgOC2lWq64vx648dW-DDR9lq7GXRo86nWxt8psGlDUaAEdI8OV3IJqAo4DXivJ-gBpZE7moLJo31-RjWsByT-zke0L6fX0MUcb0q90QK-FoJIv8tLIRyeSpDxnljsJfqnIx8 Aug 17 08:49:14.190997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:49:14.190997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:49:14.190997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:49:14.190997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:49:14.190997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:49:14.190997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:49:14.190997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: 79af4e4c37954eccba4385577ce68dcd Aug 17 08:49:14.190997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-VolumesActionsTest-1519454728 Aug 17 08:49:14.190997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:49:14.190997 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:49:14.192759 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/79af4e4c37954eccba4385577ce68dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/79af4e4c37954eccba4385577ce68dcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/79af4e4c37954eccba4385577ce68dcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_79af4e4c37954eccba4385577ce68dcd", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:49:14.192759 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-VolumesActionsTest-1519454728 Aug 17 08:49:14.192759 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 79af4e4c37954eccba4385577ce68dcd Aug 17 08:49:14.192759 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-VolumesActionsTest-1519454728 Aug 17 08:49:14.192759 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-VolumesActionsTest-1519454728-project Aug 17 08:49:14.192759 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:49:14.192759 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:49:14.192759 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: 3e33d51101b14589a7e440be6fdbb20d Aug 17 08:49:14.192759 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-VolumesActionsTest-1519454728-project Aug 17 08:49:14.192759 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: > Aug 17 08:49:14.192759 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Instance 80c263df-2026-4155-8e87-c387c665c799 could not be found. Aug 17 08:49:14.192759 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': '80c263df-2026-4155-8e87-c387c665c799'} Aug 17 08:49:14.193960 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:49:14.193960 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:49:14.193960 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:49:14.193960 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:49:14.193960 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:49:14.193960 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:49:14.193960 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:49:14.193960 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:49:14.193960 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:49:14.193960 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:49:14.193960 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80c263df-2026-4155-8e87-c387c665c799 could not be found. Aug 17 08:49:14.193960 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:49:14.193960 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:49:14.193960 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:49:14.193960 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:49:14.193960 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:49:14.193960 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:49:14.193960 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:49:14.193960 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:49:14.193960 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:49:14.195347 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:49:14.195347 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:49:14.195347 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:49:14.195347 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:49:14.195347 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:49:14.195347 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:49:14.195347 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:49:14.195347 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80c263df-2026-4155-8e87-c387c665c799 could not be found. Aug 17 08:49:14.195347 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:49:14.195347 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:49:14.195347 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:49:14.195347 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:49:14.195347 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:49:14.195347 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:49:14.195347 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:49:14.195347 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:49:14.195347 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80c263df-2026-4155-8e87-c387c665c799 could not be found. Aug 17 08:49:14.195347 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:49:14.196610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-14966d2f-bf7e-4abb-a217-cf33dbae9291 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Returning 404 to user: Instance 80c263df-2026-4155-8e87-c387c665c799 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:49:14.196610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-14966d2f-bf7e-4abb-a217-cf33dbae9291 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799" status: 404 len: 111 microversion: 2.1 time: 0.035105 Aug 17 08:49:14.197379 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 470/926] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:14 2022] GET /compute/v2.1/servers/80c263df-2026-4155-8e87-c387c665c799 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:49:14.293875 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d813bb05-6e2d-4d95-9a23-50b554f23f6c tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1973707621", "imageRef": "4467450c-a35c-42e3-af85-a13291b0b2aa", "flavorRef": "452", "networks": [{"uuid": "f49d00c8-24ee-4d4a-8e2f-3616d765dd6c"}]}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:49:14.347299 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.network.neutron [None req-d813bb05-6e2d-4d95-9a23-50b554f23f6c tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] validate_networks() for [('f49d00c8-24ee-4d4a-8e2f-3616d765dd6c', None, None, None, None, None)] {{(pid=127298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 08:49:14.806540 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-d813bb05-6e2d-4d95-9a23-50b554f23f6c tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Flavor limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 08:49:14.806954 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-d813bb05-6e2d-4d95-9a23-50b554f23f6c tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Image limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 08:49:14.807423 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-d813bb05-6e2d-4d95-9a23-50b554f23f6c tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Flavor pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 08:49:14.807860 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-d813bb05-6e2d-4d95-9a23-50b554f23f6c tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Image pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 08:49:14.808294 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-d813bb05-6e2d-4d95-9a23-50b554f23f6c tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 08:49:14.817251 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d813bb05-6e2d-4d95-9a23-50b554f23f6c tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:14.817753 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d813bb05-6e2d-4d95-9a23-50b554f23f6c tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:14.818190 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d813bb05-6e2d-4d95-9a23-50b554f23f6c tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:14.818908 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d813bb05-6e2d-4d95-9a23-50b554f23f6c tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:14.819366 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d813bb05-6e2d-4d95-9a23-50b554f23f6c tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:14.820323 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d813bb05-6e2d-4d95-9a23-50b554f23f6c tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:14.837798 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-d813bb05-6e2d-4d95-9a23-50b554f23f6c tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Getting quotas for project 79af4e4c37954eccba4385577ce68dcd. Resources: {'cores', 'instances', 'ram'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:49:14.841737 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-d813bb05-6e2d-4d95-9a23-50b554f23f6c tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Getting quotas for user 3e33d51101b14589a7e440be6fdbb20d and project 79af4e4c37954eccba4385577ce68dcd. Resources: {'cores', 'instances', 'ram'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:49:14.852545 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d813bb05-6e2d-4d95-9a23-50b554f23f6c tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Going to run 1 instances... {{(pid=127298) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 08:49:14.854773 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d813bb05-6e2d-4d95-9a23-50b554f23f6c tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: bfa341e9-031b-4919-a298-3a42801401de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4467450c-a35c-42e3-af85-a13291b0b2aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 08:49:14.900619 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d813bb05-6e2d-4d95-9a23-50b554f23f6c tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610464 Aug 17 08:49:14.901317 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 457/927] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 08:49:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 08:49:14.912290 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-fc7fbe08-a837-4d7a-b351-e5b39af90ef6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:14.912900 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fc7fbe08-a837-4d7a-b351-e5b39af90ef6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: bfa341e9-031b-4919-a298-3a42801401de] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:14.968628 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-fc7fbe08-a837-4d7a-b351-e5b39af90ef6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:14.975487 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-fc7fbe08-a837-4d7a-b351-e5b39af90ef6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de" status: 200 len: 1214 microversion: 2.1 time: 0.067013 Aug 17 08:49:14.976089 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 471/928] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:14 2022] GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:49:15.996311 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-95e1eaf1-3165-4083-aa2e-88d6d814a4a0 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:15.996915 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-95e1eaf1-3165-4083-aa2e-88d6d814a4a0 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: bfa341e9-031b-4919-a298-3a42801401de] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:16.004047 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-95e1eaf1-3165-4083-aa2e-88d6d814a4a0 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:16.004886 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-95e1eaf1-3165-4083-aa2e-88d6d814a4a0 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:16.005420 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-95e1eaf1-3165-4083-aa2e-88d6d814a4a0 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:16.006189 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-95e1eaf1-3165-4083-aa2e-88d6d814a4a0 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:16.006840 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-95e1eaf1-3165-4083-aa2e-88d6d814a4a0 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:16.008077 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-95e1eaf1-3165-4083-aa2e-88d6d814a4a0 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:16.086678 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-95e1eaf1-3165-4083-aa2e-88d6d814a4a0 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:16.094024 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-95e1eaf1-3165-4083-aa2e-88d6d814a4a0 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de" status: 200 len: 1272 microversion: 2.1 time: 0.102542 Aug 17 08:49:16.094580 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 458/929] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:15 2022] GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de => generated 1272 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:49:17.114975 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-ac0ff2d5-f492-4a37-83db-868d62136692 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:17.115779 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-ac0ff2d5-f492-4a37-83db-868d62136692 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: bfa341e9-031b-4919-a298-3a42801401de] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:17.123611 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ac0ff2d5-f492-4a37-83db-868d62136692 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:17.124126 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ac0ff2d5-f492-4a37-83db-868d62136692 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:17.124559 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ac0ff2d5-f492-4a37-83db-868d62136692 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:17.125245 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ac0ff2d5-f492-4a37-83db-868d62136692 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:17.125827 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ac0ff2d5-f492-4a37-83db-868d62136692 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:17.126306 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-ac0ff2d5-f492-4a37-83db-868d62136692 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:17.146868 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-ecbf9570-fdb6-4357-bd8d-22fe02bdf523 req-1d38d2a8-050a-43d7-be96-f8261d4b2f63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfa341e9-031b-4919-a298-3a42801401de", "tag": "982fd73d-4f5d-4be3-aa8e-29f74821d027"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:49:17.160585 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-ecbf9570-fdb6-4357-bd8d-22fe02bdf523 req-1d38d2a8-050a-43d7-be96-f8261d4b2f63 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:17.161065 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-ecbf9570-fdb6-4357-bd8d-22fe02bdf523 req-1d38d2a8-050a-43d7-be96-f8261d4b2f63 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:17.161477 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-ecbf9570-fdb6-4357-bd8d-22fe02bdf523 req-1d38d2a8-050a-43d7-be96-f8261d4b2f63 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:17.173562 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-ecbf9570-fdb6-4357-bd8d-22fe02bdf523 req-1d38d2a8-050a-43d7-be96-f8261d4b2f63 service nova] Creating event network-changed:982fd73d-4f5d-4be3-aa8e-29f74821d027 for instance bfa341e9-031b-4919-a298-3a42801401de on hv-cinder-85331 Aug 17 08:49:17.187926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-ecbf9570-fdb6-4357-bd8d-22fe02bdf523 req-1d38d2a8-050a-43d7-be96-f8261d4b2f63 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040359 Aug 17 08:49:17.188582 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 459/930] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:49:17.277656 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-ac0ff2d5-f492-4a37-83db-868d62136692 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:17.288952 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-ac0ff2d5-f492-4a37-83db-868d62136692 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de" status: 200 len: 1314 microversion: 2.1 time: 0.177797 Aug 17 08:49:17.289891 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 472/931] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:17 2022] GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:49:18.315151 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-da27c9b1-3973-469c-8b27-60c096a8777b tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:18.315644 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-da27c9b1-3973-469c-8b27-60c096a8777b tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: bfa341e9-031b-4919-a298-3a42801401de] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:18.322471 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-da27c9b1-3973-469c-8b27-60c096a8777b tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:18.323289 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-da27c9b1-3973-469c-8b27-60c096a8777b tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:18.324000 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-da27c9b1-3973-469c-8b27-60c096a8777b tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:18.324937 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-da27c9b1-3973-469c-8b27-60c096a8777b tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:18.325473 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-da27c9b1-3973-469c-8b27-60c096a8777b tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:18.325966 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-da27c9b1-3973-469c-8b27-60c096a8777b tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:18.550677 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-da27c9b1-3973-469c-8b27-60c096a8777b tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:18.559321 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-da27c9b1-3973-469c-8b27-60c096a8777b tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de" status: 200 len: 1314 microversion: 2.1 time: 0.252853 Aug 17 08:49:18.571725 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 460/932] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:18 2022] GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:49:19.580749 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4113f9d4-7753-4e2b-be61-6354d91bd080 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:19.581354 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-4113f9d4-7753-4e2b-be61-6354d91bd080 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: bfa341e9-031b-4919-a298-3a42801401de] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:19.587885 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4113f9d4-7753-4e2b-be61-6354d91bd080 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:19.588362 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4113f9d4-7753-4e2b-be61-6354d91bd080 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:19.588785 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4113f9d4-7753-4e2b-be61-6354d91bd080 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:19.589459 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4113f9d4-7753-4e2b-be61-6354d91bd080 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:19.589902 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4113f9d4-7753-4e2b-be61-6354d91bd080 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:19.590340 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4113f9d4-7753-4e2b-be61-6354d91bd080 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:19.722947 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-4113f9d4-7753-4e2b-be61-6354d91bd080 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:19.730971 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4113f9d4-7753-4e2b-be61-6354d91bd080 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de" status: 200 len: 1314 microversion: 2.1 time: 0.154235 Aug 17 08:49:19.731554 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 473/933] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:19 2022] GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:49:20.751053 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d7ee4486-027f-40a8-ba51-ec366ab4e4b6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:20.751717 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d7ee4486-027f-40a8-ba51-ec366ab4e4b6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: bfa341e9-031b-4919-a298-3a42801401de] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:20.758353 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d7ee4486-027f-40a8-ba51-ec366ab4e4b6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:20.758834 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d7ee4486-027f-40a8-ba51-ec366ab4e4b6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:20.759275 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d7ee4486-027f-40a8-ba51-ec366ab4e4b6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:20.759973 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d7ee4486-027f-40a8-ba51-ec366ab4e4b6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:20.760424 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d7ee4486-027f-40a8-ba51-ec366ab4e4b6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:20.760843 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d7ee4486-027f-40a8-ba51-ec366ab4e4b6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:20.892480 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-d7ee4486-027f-40a8-ba51-ec366ab4e4b6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:20.900294 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d7ee4486-027f-40a8-ba51-ec366ab4e4b6 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de" status: 200 len: 1314 microversion: 2.1 time: 0.152985 Aug 17 08:49:20.900865 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 461/934] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:20 2022] GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:49:21.920992 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-31a19bec-3dd4-4108-8a25-8300e109150a tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:21.921612 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-31a19bec-3dd4-4108-8a25-8300e109150a tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: bfa341e9-031b-4919-a298-3a42801401de] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:21.928287 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-31a19bec-3dd4-4108-8a25-8300e109150a tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:21.928781 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-31a19bec-3dd4-4108-8a25-8300e109150a tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:21.929213 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-31a19bec-3dd4-4108-8a25-8300e109150a tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:21.929904 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-31a19bec-3dd4-4108-8a25-8300e109150a tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:21.930863 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-31a19bec-3dd4-4108-8a25-8300e109150a tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:21.931283 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-31a19bec-3dd4-4108-8a25-8300e109150a tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:22.062952 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-31a19bec-3dd4-4108-8a25-8300e109150a tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:22.070577 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-31a19bec-3dd4-4108-8a25-8300e109150a tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de" status: 200 len: 1314 microversion: 2.1 time: 0.153486 Aug 17 08:49:22.071790 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 474/935] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:21 2022] GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:49:23.092449 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f471b9e5-c468-40a0-8921-2af9655eccbf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:23.093065 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f471b9e5-c468-40a0-8921-2af9655eccbf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: bfa341e9-031b-4919-a298-3a42801401de] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:23.099436 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f471b9e5-c468-40a0-8921-2af9655eccbf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:23.099952 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f471b9e5-c468-40a0-8921-2af9655eccbf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:23.100386 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f471b9e5-c468-40a0-8921-2af9655eccbf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:23.101068 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f471b9e5-c468-40a0-8921-2af9655eccbf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:23.101518 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f471b9e5-c468-40a0-8921-2af9655eccbf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:23.101949 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f471b9e5-c468-40a0-8921-2af9655eccbf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:23.237313 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f471b9e5-c468-40a0-8921-2af9655eccbf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:23.245248 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f471b9e5-c468-40a0-8921-2af9655eccbf tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de" status: 200 len: 1314 microversion: 2.1 time: 0.156645 Aug 17 08:49:23.245796 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 462/936] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:23 2022] GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:49:23.467199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-3ccddd29-bcd5-4ed2-9325-eace317e10d3 req-b3f46896-df2a-4ba7-b624-707cde09f4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfa341e9-031b-4919-a298-3a42801401de", "name": "network-vif-plugged", "status": "completed", "tag": "982fd73d-4f5d-4be3-aa8e-29f74821d027"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:49:23.478357 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-3ccddd29-bcd5-4ed2-9325-eace317e10d3 req-b3f46896-df2a-4ba7-b624-707cde09f4b4 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:23.479044 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-3ccddd29-bcd5-4ed2-9325-eace317e10d3 req-b3f46896-df2a-4ba7-b624-707cde09f4b4 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:23.479998 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-3ccddd29-bcd5-4ed2-9325-eace317e10d3 req-b3f46896-df2a-4ba7-b624-707cde09f4b4 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:23.491425 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-3ccddd29-bcd5-4ed2-9325-eace317e10d3 req-b3f46896-df2a-4ba7-b624-707cde09f4b4 service nova] Creating event network-vif-plugged:982fd73d-4f5d-4be3-aa8e-29f74821d027 for instance bfa341e9-031b-4919-a298-3a42801401de on hv-cinder-85331 Aug 17 08:49:23.497123 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-3ccddd29-bcd5-4ed2-9325-eace317e10d3 req-b3f46896-df2a-4ba7-b624-707cde09f4b4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033695 Aug 17 08:49:23.498061 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 475/937] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:49:24.265535 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-8241c559-e2a0-4561-a286-fa8e5fd5b215 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:24.266254 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-8241c559-e2a0-4561-a286-fa8e5fd5b215 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: bfa341e9-031b-4919-a298-3a42801401de] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:24.275828 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8241c559-e2a0-4561-a286-fa8e5fd5b215 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:24.276317 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8241c559-e2a0-4561-a286-fa8e5fd5b215 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:24.276939 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8241c559-e2a0-4561-a286-fa8e5fd5b215 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:24.277633 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8241c559-e2a0-4561-a286-fa8e5fd5b215 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:24.278125 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8241c559-e2a0-4561-a286-fa8e5fd5b215 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:24.278717 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-8241c559-e2a0-4561-a286-fa8e5fd5b215 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:24.415096 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-8241c559-e2a0-4561-a286-fa8e5fd5b215 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:24.422787 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-8241c559-e2a0-4561-a286-fa8e5fd5b215 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de" status: 200 len: 1314 microversion: 2.1 time: 0.161010 Aug 17 08:49:24.423397 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 463/938] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:24 2022] GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:49:25.444298 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-8d80a6fa-49bf-43c4-97cd-75d408adc62b tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:25.444990 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-8d80a6fa-49bf-43c4-97cd-75d408adc62b tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: bfa341e9-031b-4919-a298-3a42801401de] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:25.447359 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:25.453366 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8d80a6fa-49bf-43c4-97cd-75d408adc62b tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:25.453842 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8d80a6fa-49bf-43c4-97cd-75d408adc62b tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:25.454272 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8d80a6fa-49bf-43c4-97cd-75d408adc62b tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:25.454957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8d80a6fa-49bf-43c4-97cd-75d408adc62b tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:25.455406 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8d80a6fa-49bf-43c4-97cd-75d408adc62b tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:25.455862 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-8d80a6fa-49bf-43c4-97cd-75d408adc62b tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:25.586767 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-8d80a6fa-49bf-43c4-97cd-75d408adc62b tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:25.594402 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-8d80a6fa-49bf-43c4-97cd-75d408adc62b tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de" status: 200 len: 1498 microversion: 2.1 time: 0.154403 Aug 17 08:49:25.594980 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 476/939] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:25 2022] GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:49:26.169918 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-47f332e4-24b0-47d0-ac35-960d69a6c073 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:26.170434 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-47f332e4-24b0-47d0-ac35-960d69a6c073 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: bfa341e9-031b-4919-a298-3a42801401de] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:26.172472 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:26.173122 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=6 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:26.179576 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-47f332e4-24b0-47d0-ac35-960d69a6c073 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:26.180215 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-47f332e4-24b0-47d0-ac35-960d69a6c073 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:26.180651 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-47f332e4-24b0-47d0-ac35-960d69a6c073 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:26.181566 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-47f332e4-24b0-47d0-ac35-960d69a6c073 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:26.182019 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-47f332e4-24b0-47d0-ac35-960d69a6c073 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:26.182441 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-47f332e4-24b0-47d0-ac35-960d69a6c073 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:26.208617 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-47f332e4-24b0-47d0-ac35-960d69a6c073 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: bfa341e9-031b-4919-a298-3a42801401de] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 08:49:26.235268 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:26.286126 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-47f332e4-24b0-47d0-ac35-960d69a6c073 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de" status: 204 len: 0 microversion: 2.1 time: 0.119662 Aug 17 08:49:26.286872 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 464/940] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:49:26 2022] DELETE /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 08:49:26.295457 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-915321a0-6669-46ed-8e61-9816f67a0594 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:26.296094 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-915321a0-6669-46ed-8e61-9816f67a0594 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: bfa341e9-031b-4919-a298-3a42801401de] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:26.302001 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-915321a0-6669-46ed-8e61-9816f67a0594 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:26.302477 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-915321a0-6669-46ed-8e61-9816f67a0594 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:26.302906 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-915321a0-6669-46ed-8e61-9816f67a0594 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:26.303639 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-915321a0-6669-46ed-8e61-9816f67a0594 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:26.304096 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-915321a0-6669-46ed-8e61-9816f67a0594 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:26.304601 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-915321a0-6669-46ed-8e61-9816f67a0594 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:26.436301 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-915321a0-6669-46ed-8e61-9816f67a0594 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:26.443582 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-915321a0-6669-46ed-8e61-9816f67a0594 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de" status: 200 len: 1504 microversion: 2.1 time: 0.151957 Aug 17 08:49:26.444141 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 477/941] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:26 2022] GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:49:27.466071 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-61be22de-57cd-434f-8ab4-a106aff759ee tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:27.466792 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-61be22de-57cd-434f-8ab4-a106aff759ee tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: bfa341e9-031b-4919-a298-3a42801401de] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:27.473242 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-61be22de-57cd-434f-8ab4-a106aff759ee tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:27.473723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-61be22de-57cd-434f-8ab4-a106aff759ee tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:27.474150 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-61be22de-57cd-434f-8ab4-a106aff759ee tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:27.474831 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-61be22de-57cd-434f-8ab4-a106aff759ee tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:27.475281 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-61be22de-57cd-434f-8ab4-a106aff759ee tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:27.475738 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-61be22de-57cd-434f-8ab4-a106aff759ee tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:27.611523 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-61be22de-57cd-434f-8ab4-a106aff759ee tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:27.619770 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-61be22de-57cd-434f-8ab4-a106aff759ee tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de" status: 200 len: 1504 microversion: 2.1 time: 0.158386 Aug 17 08:49:27.620327 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 465/942] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:27 2022] GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:49:28.444573 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-a48260a4-d60b-458f-b7d2-b50faaf80857 req-71443b39-e9e3-47d3-becf-86cb29f8e9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfa341e9-031b-4919-a298-3a42801401de", "name": "network-vif-deleted", "tag": "982fd73d-4f5d-4be3-aa8e-29f74821d027"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:49:28.455279 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-a48260a4-d60b-458f-b7d2-b50faaf80857 req-71443b39-e9e3-47d3-becf-86cb29f8e9d3 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:28.455843 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-a48260a4-d60b-458f-b7d2-b50faaf80857 req-71443b39-e9e3-47d3-becf-86cb29f8e9d3 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:28.456271 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-a48260a4-d60b-458f-b7d2-b50faaf80857 req-71443b39-e9e3-47d3-becf-86cb29f8e9d3 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:28.470364 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-a48260a4-d60b-458f-b7d2-b50faaf80857 req-71443b39-e9e3-47d3-becf-86cb29f8e9d3 service nova] Creating event network-vif-deleted:982fd73d-4f5d-4be3-aa8e-29f74821d027 for instance bfa341e9-031b-4919-a298-3a42801401de on hv-cinder-85331 Aug 17 08:49:28.476205 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-a48260a4-d60b-458f-b7d2-b50faaf80857 req-71443b39-e9e3-47d3-becf-86cb29f8e9d3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034508 Aug 17 08:49:28.477391 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 478/943] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:49:28.640615 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-bc1d0256-5379-467f-8b44-abe26e0e05e2 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:28.641239 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-bc1d0256-5379-467f-8b44-abe26e0e05e2 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: bfa341e9-031b-4919-a298-3a42801401de] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:28.648280 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc1d0256-5379-467f-8b44-abe26e0e05e2 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:28.649344 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc1d0256-5379-467f-8b44-abe26e0e05e2 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:28.650019 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc1d0256-5379-467f-8b44-abe26e0e05e2 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:28.651064 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc1d0256-5379-467f-8b44-abe26e0e05e2 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:28.651677 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc1d0256-5379-467f-8b44-abe26e0e05e2 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:28.652098 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc1d0256-5379-467f-8b44-abe26e0e05e2 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:28.685324 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc1d0256-5379-467f-8b44-abe26e0e05e2 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:28.686777 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc1d0256-5379-467f-8b44-abe26e0e05e2 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:28.687209 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-bc1d0256-5379-467f-8b44-abe26e0e05e2 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:28.687676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.objects.instance [None req-bc1d0256-5379-467f-8b44-abe26e0e05e2 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lazy-loading 'fault' on Instance uuid bfa341e9-031b-4919-a298-3a42801401de {{(pid=127298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 08:49:28.730292 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-bc1d0256-5379-467f-8b44-abe26e0e05e2 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e33d51101b14589a7e440be6fdbb20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79af4e4c37954eccba4385577ce68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:28.737811 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-bc1d0256-5379-467f-8b44-abe26e0e05e2 tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de" status: 200 len: 1304 microversion: 2.1 time: 0.101079 Aug 17 08:49:28.738371 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 466/944] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:28 2022] GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:49:29.760223 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5e6dac23-5fdd-49c6-a030-91b35d52541f tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:29.760934 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-5e6dac23-5fdd-49c6-a030-91b35d52541f tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] [instance: bfa341e9-031b-4919-a298-3a42801401de] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:29.762873 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:29.768456 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5e6dac23-5fdd-49c6-a030-91b35d52541f tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:29.768934 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5e6dac23-5fdd-49c6-a030-91b35d52541f tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:29.769366 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5e6dac23-5fdd-49c6-a030-91b35d52541f tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:29.770048 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5e6dac23-5fdd-49c6-a030-91b35d52541f tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:29.770498 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5e6dac23-5fdd-49c6-a030-91b35d52541f tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:29.770920 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5e6dac23-5fdd-49c6-a030-91b35d52541f tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:29.774593 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=79 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:29.786527 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-5e6dac23-5fdd-49c6-a030-91b35d52541f tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] HTTP exception thrown: Instance bfa341e9-031b-4919-a298-3a42801401de could not be found. Aug 17 08:49:29.788199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5e6dac23-5fdd-49c6-a030-91b35d52541f tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Request method failure captured: Aug 17 08:49:29.788199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de HTTP/1.1 Aug 17 08:49:29.788199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:49:29.788199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:49:29.788199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:49:29.788199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:49:29.788199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:49:29.788199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:49:29.788199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:49:29.788199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:49:29.788199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_Kt4M91g38Q3NpaiiQ4x9jbrh3H4T5XRE5NT4Ld6pQ6TgOC2lWq64vx648dW-DDR9lq7GXRo86nWxt8psGlDUaAEdI8OV3IJqAo4DXivJ-gBpZE7moLJo31-RjWsByT-zke0L6fX0MUcb0q90QK-FoJIv8tLIRyeSpDxnljsJfqnIx8 Aug 17 08:49:29.788199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:49:29.788199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:49:29.788199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:49:29.788199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:49:29.788199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:49:29.788199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:49:29.788199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: 79af4e4c37954eccba4385577ce68dcd Aug 17 08:49:29.788199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-VolumesActionsTest-1519454728 Aug 17 08:49:29.788199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:49:29.788199 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:49:29.790331 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/79af4e4c37954eccba4385577ce68dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/79af4e4c37954eccba4385577ce68dcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/79af4e4c37954eccba4385577ce68dcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_79af4e4c37954eccba4385577ce68dcd", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:49:29.790331 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-VolumesActionsTest-1519454728 Aug 17 08:49:29.790331 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: 79af4e4c37954eccba4385577ce68dcd Aug 17 08:49:29.790331 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-VolumesActionsTest-1519454728 Aug 17 08:49:29.790331 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-VolumesActionsTest-1519454728-project Aug 17 08:49:29.790331 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:49:29.790331 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:49:29.790331 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: 3e33d51101b14589a7e440be6fdbb20d Aug 17 08:49:29.790331 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-VolumesActionsTest-1519454728-project Aug 17 08:49:29.790331 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: > Aug 17 08:49:29.790331 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Instance bfa341e9-031b-4919-a298-3a42801401de could not be found. Aug 17 08:49:29.790331 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': 'bfa341e9-031b-4919-a298-3a42801401de'} Aug 17 08:49:29.791215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:49:29.791215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:49:29.791215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:49:29.791215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:49:29.791215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:49:29.791215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:49:29.791215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:49:29.791215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:49:29.791215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:49:29.791215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:49:29.791215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfa341e9-031b-4919-a298-3a42801401de could not be found. Aug 17 08:49:29.791215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:49:29.791215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:49:29.791215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:49:29.791215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:49:29.791215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:49:29.791215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:49:29.791215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:49:29.791215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:49:29.791215 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:49:29.793295 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:49:29.793295 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:49:29.793295 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:49:29.793295 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:49:29.793295 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:49:29.793295 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:49:29.793295 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:49:29.793295 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfa341e9-031b-4919-a298-3a42801401de could not be found. Aug 17 08:49:29.793295 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:49:29.793295 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:49:29.793295 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:49:29.793295 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:49:29.793295 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:49:29.793295 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:49:29.793295 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:49:29.793295 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:49:29.793295 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfa341e9-031b-4919-a298-3a42801401de could not be found. Aug 17 08:49:29.793295 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:49:29.795128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5e6dac23-5fdd-49c6-a030-91b35d52541f tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] Returning 404 to user: Instance bfa341e9-031b-4919-a298-3a42801401de could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:49:29.795128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-5e6dac23-5fdd-49c6-a030-91b35d52541f tempest-VolumesActionsTest-1519454728 tempest-VolumesActionsTest-1519454728-project] 10.222.0.15 "GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de" status: 404 len: 111 microversion: 2.1 time: 0.034796 Aug 17 08:49:29.795128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 479/945] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:29 2022] GET /compute/v2.1/servers/bfa341e9-031b-4919-a298-3a42801401de => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:49:56.860548 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-03ea3105-d26c-4b13-a65a-96c5ad96d5f5 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-585353427", "imageRef": "4467450c-a35c-42e3-af85-a13291b0b2aa", "flavorRef": "452"}} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:49:56.868065 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:56.868842 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=18,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:56.916635 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.network.neutron [None req-03ea3105-d26c-4b13-a65a-96c5ad96d5f5 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] validate_networks() for None {{(pid=127298) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 08:49:57.201106 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-03ea3105-d26c-4b13-a65a-96c5ad96d5f5 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Flavor limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 08:49:57.201523 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-03ea3105-d26c-4b13-a65a-96c5ad96d5f5 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Image limits 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 08:49:57.202210 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-03ea3105-d26c-4b13-a65a-96c5ad96d5f5 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Flavor pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 08:49:57.202583 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-03ea3105-d26c-4b13-a65a-96c5ad96d5f5 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Image pref 0:0:0 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 08:49:57.203029 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.virt.hardware [None req-03ea3105-d26c-4b13-a65a-96c5ad96d5f5 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 08:49:57.212100 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-03ea3105-d26c-4b13-a65a-96c5ad96d5f5 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:57.212574 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-03ea3105-d26c-4b13-a65a-96c5ad96d5f5 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:57.212999 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-03ea3105-d26c-4b13-a65a-96c5ad96d5f5 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:57.213710 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-03ea3105-d26c-4b13-a65a-96c5ad96d5f5 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:57.214158 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-03ea3105-d26c-4b13-a65a-96c5ad96d5f5 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:57.214575 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-03ea3105-d26c-4b13-a65a-96c5ad96d5f5 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:57.232803 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-03ea3105-d26c-4b13-a65a-96c5ad96d5f5 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Getting quotas for project 2e178d565fec4597a8089a7a6850d2ab. Resources: {'cores', 'instances', 'ram'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:49:57.236505 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.quota [None req-03ea3105-d26c-4b13-a65a-96c5ad96d5f5 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Getting quotas for user a6a897aa2a6a4152b55446073a3ba858 and project 2e178d565fec4597a8089a7a6850d2ab. Resources: {'cores', 'instances', 'ram'} {{(pid=127298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:49:57.248305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-03ea3105-d26c-4b13-a65a-96c5ad96d5f5 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Going to run 1 instances... {{(pid=127298) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 08:49:57.250553 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-03ea3105-d26c-4b13-a65a-96c5ad96d5f5 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] [instance: 156b3d66-a8ac-45d0-8355-1ca428279901] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4467450c-a35c-42e3-af85-a13291b0b2aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 08:49:57.296464 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-03ea3105-d26c-4b13-a65a-96c5ad96d5f5 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.439676 Aug 17 08:49:57.297095 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 467/946] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 08:49:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 08:49:57.308703 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-e5e4ed56-ba72-43f3-863b-da7a42ad28a6 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:57.309449 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-e5e4ed56-ba72-43f3-863b-da7a42ad28a6 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] [instance: 156b3d66-a8ac-45d0-8355-1ca428279901] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:57.315321 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:57.316650 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=1 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:49:57.370669 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-e5e4ed56-ba72-43f3-863b-da7a42ad28a6 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a897aa2a6a4152b55446073a3ba858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e178d565fec4597a8089a7a6850d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:57.377265 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-e5e4ed56-ba72-43f3-863b-da7a42ad28a6 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] 10.222.0.15 "GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901" status: 200 len: 1214 microversion: 2.1 time: 0.073321 Aug 17 08:49:57.377826 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 480/947] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:57 2022] GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:49:58.398582 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-722b4ea9-757c-44bf-9f60-62e2d6b4cfdb tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:58.399180 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-722b4ea9-757c-44bf-9f60-62e2d6b4cfdb tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] [instance: 156b3d66-a8ac-45d0-8355-1ca428279901] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:58.406729 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-722b4ea9-757c-44bf-9f60-62e2d6b4cfdb tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:58.407201 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-722b4ea9-757c-44bf-9f60-62e2d6b4cfdb tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:58.407875 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-722b4ea9-757c-44bf-9f60-62e2d6b4cfdb tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:58.408560 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-722b4ea9-757c-44bf-9f60-62e2d6b4cfdb tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:58.409019 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-722b4ea9-757c-44bf-9f60-62e2d6b4cfdb tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:58.409418 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-722b4ea9-757c-44bf-9f60-62e2d6b4cfdb tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:58.493304 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-722b4ea9-757c-44bf-9f60-62e2d6b4cfdb tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a897aa2a6a4152b55446073a3ba858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e178d565fec4597a8089a7a6850d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:58.501327 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-722b4ea9-757c-44bf-9f60-62e2d6b4cfdb tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] 10.222.0.15 "GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901" status: 200 len: 1284 microversion: 2.1 time: 0.106550 Aug 17 08:49:58.502545 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 468/948] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:58 2022] GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901 => generated 1284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:49:59.522108 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-1c574294-8185-426e-9c04-2368048baf34 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:49:59.522729 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-1c574294-8185-426e-9c04-2368048baf34 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] [instance: 156b3d66-a8ac-45d0-8355-1ca428279901] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:49:59.533133 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1c574294-8185-426e-9c04-2368048baf34 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:59.533866 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1c574294-8185-426e-9c04-2368048baf34 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:59.534303 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1c574294-8185-426e-9c04-2368048baf34 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:59.534992 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1c574294-8185-426e-9c04-2368048baf34 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:59.535439 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1c574294-8185-426e-9c04-2368048baf34 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:49:59.535890 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-1c574294-8185-426e-9c04-2368048baf34 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:49:59.674506 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-1c574294-8185-426e-9c04-2368048baf34 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a897aa2a6a4152b55446073a3ba858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e178d565fec4597a8089a7a6850d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:49:59.681830 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-1c574294-8185-426e-9c04-2368048baf34 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] 10.222.0.15 "GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901" status: 200 len: 1314 microversion: 2.1 time: 0.163682 Aug 17 08:49:59.682395 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 481/949] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:49:59 2022] GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:49:59.987258 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-d71e8683-355c-4c26-8199-085cd1c4fb93 req-8659db96-7dcf-4c81-b20f-c48617f84f92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "156b3d66-a8ac-45d0-8355-1ca428279901", "tag": "400ef3e0-3b51-4e32-87fc-82b0b1ca97e2"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:49:59.999101 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-d71e8683-355c-4c26-8199-085cd1c4fb93 req-8659db96-7dcf-4c81-b20f-c48617f84f92 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:49:59.999984 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-d71e8683-355c-4c26-8199-085cd1c4fb93 req-8659db96-7dcf-4c81-b20f-c48617f84f92 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:00.000406 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-d71e8683-355c-4c26-8199-085cd1c4fb93 req-8659db96-7dcf-4c81-b20f-c48617f84f92 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:00.013312 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-d71e8683-355c-4c26-8199-085cd1c4fb93 req-8659db96-7dcf-4c81-b20f-c48617f84f92 service nova] Creating event network-changed:400ef3e0-3b51-4e32-87fc-82b0b1ca97e2 for instance 156b3d66-a8ac-45d0-8355-1ca428279901 on hv-cinder-85331 Aug 17 08:50:00.018899 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-d71e8683-355c-4c26-8199-085cd1c4fb93 req-8659db96-7dcf-4c81-b20f-c48617f84f92 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035425 Aug 17 08:50:00.019479 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 469/950] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:50:00.609002 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-83dd7e2e-7734-4261-8b66-ff97e56598cd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-671784398", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-450789034", "security_groups": [{"name": "tempest-secgroup-smoke-604269867"}], "block_device_mapping_v2": [{"uuid": "c4d839f4-c87d-4440-b49b-32124247fbdb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2cc8fb46-3628-4864-93c3-c9178d343e2b"}]}} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:50:00.703348 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-7d3f0751-a96f-4fb8-b09c-87ca307ed521 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:00.704066 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7d3f0751-a96f-4fb8-b09c-87ca307ed521 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] [instance: 156b3d66-a8ac-45d0-8355-1ca428279901] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:00.710261 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7d3f0751-a96f-4fb8-b09c-87ca307ed521 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:00.710742 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7d3f0751-a96f-4fb8-b09c-87ca307ed521 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:00.711366 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7d3f0751-a96f-4fb8-b09c-87ca307ed521 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:00.712101 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7d3f0751-a96f-4fb8-b09c-87ca307ed521 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:00.713204 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7d3f0751-a96f-4fb8-b09c-87ca307ed521 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:00.713800 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7d3f0751-a96f-4fb8-b09c-87ca307ed521 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:00.728956 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.network.neutron [None req-83dd7e2e-7734-4261-8b66-ff97e56598cd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] validate_networks() for [('2cc8fb46-3628-4864-93c3-c9178d343e2b', None, None, None, None, None)] {{(pid=127297) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 08:50:00.865681 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-7d3f0751-a96f-4fb8-b09c-87ca307ed521 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a897aa2a6a4152b55446073a3ba858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e178d565fec4597a8089a7a6850d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:00.875487 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-7d3f0751-a96f-4fb8-b09c-87ca307ed521 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] 10.222.0.15 "GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901" status: 200 len: 1314 microversion: 2.1 time: 0.176482 Aug 17 08:50:00.876504 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 470/951] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:00 2022] GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:50:01.133186 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-83dd7e2e-7734-4261-8b66-ff97e56598cd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Flavor limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 08:50:01.133600 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-83dd7e2e-7734-4261-8b66-ff97e56598cd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Image limits 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 08:50:01.134066 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-83dd7e2e-7734-4261-8b66-ff97e56598cd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Flavor pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 08:50:01.135080 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-83dd7e2e-7734-4261-8b66-ff97e56598cd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Image pref 0:0:0 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 08:50:01.135483 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.virt.hardware [None req-83dd7e2e-7734-4261-8b66-ff97e56598cd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 08:50:01.144863 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-83dd7e2e-7734-4261-8b66-ff97e56598cd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:01.145440 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-83dd7e2e-7734-4261-8b66-ff97e56598cd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:01.145989 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-83dd7e2e-7734-4261-8b66-ff97e56598cd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:01.146724 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-83dd7e2e-7734-4261-8b66-ff97e56598cd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:01.147267 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-83dd7e2e-7734-4261-8b66-ff97e56598cd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:01.147721 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-83dd7e2e-7734-4261-8b66-ff97e56598cd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:01.164969 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-83dd7e2e-7734-4261-8b66-ff97e56598cd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Getting quotas for project e2604417eb5f48f0b026b00a9c164e08. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 08:50:01.169337 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.quota [None req-83dd7e2e-7734-4261-8b66-ff97e56598cd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Getting quotas for user 73a4f1987dda43068520217d36d99799 and project e2604417eb5f48f0b026b00a9c164e08. Resources: {'cores', 'instances', 'ram'} {{(pid=127297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 08:50:01.225796 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-83dd7e2e-7734-4261-8b66-ff97e56598cd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Going to run 1 instances... {{(pid=127297) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 08:50:01.227924 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-83dd7e2e-7734-4261-8b66-ff97e56598cd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: e4cef611-f8ca-402e-8044-f9280bed1394] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c4d839f4-c87d-4440-b49b-32124247fbdb',volume_size=None,volume_type=None)] {{(pid=127297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 08:50:01.357869 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-83dd7e2e-7734-4261-8b66-ff97e56598cd tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.752721 Aug 17 08:50:01.358766 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 482/952] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 08:50:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 08:50:01.370082 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-2a06433e-4da7-4b20-a921-fbbccaeb5076 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:01.371276 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-2a06433e-4da7-4b20-a921-fbbccaeb5076 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: e4cef611-f8ca-402e-8044-f9280bed1394] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:01.451828 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-2a06433e-4da7-4b20-a921-fbbccaeb5076 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:01.459258 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-2a06433e-4da7-4b20-a921-fbbccaeb5076 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394" status: 200 len: 1093 microversion: 2.1 time: 0.093003 Aug 17 08:50:01.459975 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 471/953] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:01 2022] GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394 => generated 1093 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:01.897058 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c9d86833-98e7-4279-906b-497a750c6086 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:01.897671 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c9d86833-98e7-4279-906b-497a750c6086 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] [instance: 156b3d66-a8ac-45d0-8355-1ca428279901] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:01.903734 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c9d86833-98e7-4279-906b-497a750c6086 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:01.904212 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c9d86833-98e7-4279-906b-497a750c6086 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:01.904647 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c9d86833-98e7-4279-906b-497a750c6086 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:01.905332 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c9d86833-98e7-4279-906b-497a750c6086 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:01.905786 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c9d86833-98e7-4279-906b-497a750c6086 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:01.906220 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c9d86833-98e7-4279-906b-497a750c6086 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:02.042054 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c9d86833-98e7-4279-906b-497a750c6086 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a897aa2a6a4152b55446073a3ba858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e178d565fec4597a8089a7a6850d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:02.050160 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c9d86833-98e7-4279-906b-497a750c6086 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] 10.222.0.15 "GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901" status: 200 len: 1314 microversion: 2.1 time: 0.157716 Aug 17 08:50:02.050813 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 483/954] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:01 2022] GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:02.480988 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f7341a28-a832-4997-a560-8ed76aa9d20c tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:02.482356 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f7341a28-a832-4997-a560-8ed76aa9d20c tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: e4cef611-f8ca-402e-8044-f9280bed1394] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:02.489348 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f7341a28-a832-4997-a560-8ed76aa9d20c tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:02.489894 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f7341a28-a832-4997-a560-8ed76aa9d20c tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:02.490566 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f7341a28-a832-4997-a560-8ed76aa9d20c tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:02.491319 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f7341a28-a832-4997-a560-8ed76aa9d20c tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:02.491974 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f7341a28-a832-4997-a560-8ed76aa9d20c tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:02.492723 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f7341a28-a832-4997-a560-8ed76aa9d20c tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:02.570874 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f7341a28-a832-4997-a560-8ed76aa9d20c tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:02.579517 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f7341a28-a832-4997-a560-8ed76aa9d20c tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394" status: 200 len: 1209 microversion: 2.1 time: 0.103660 Aug 17 08:50:02.580440 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 472/955] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:02 2022] GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394 => generated 1209 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:03.071563 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-12fa183b-d7d8-4822-8d8a-0cbefafb4835 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:03.072308 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-12fa183b-d7d8-4822-8d8a-0cbefafb4835 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] [instance: 156b3d66-a8ac-45d0-8355-1ca428279901] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:03.079430 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-12fa183b-d7d8-4822-8d8a-0cbefafb4835 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:03.079946 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-12fa183b-d7d8-4822-8d8a-0cbefafb4835 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:03.080391 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-12fa183b-d7d8-4822-8d8a-0cbefafb4835 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:03.081083 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-12fa183b-d7d8-4822-8d8a-0cbefafb4835 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:03.081540 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-12fa183b-d7d8-4822-8d8a-0cbefafb4835 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:03.081963 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-12fa183b-d7d8-4822-8d8a-0cbefafb4835 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:03.233726 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-12fa183b-d7d8-4822-8d8a-0cbefafb4835 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a897aa2a6a4152b55446073a3ba858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e178d565fec4597a8089a7a6850d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:03.241439 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-12fa183b-d7d8-4822-8d8a-0cbefafb4835 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] 10.222.0.15 "GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901" status: 200 len: 1314 microversion: 2.1 time: 0.173838 Aug 17 08:50:03.242188 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 484/956] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:03 2022] GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:03.600606 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f24c056f-55ed-450c-b464-cacb6612fbf5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:03.601236 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f24c056f-55ed-450c-b464-cacb6612fbf5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: e4cef611-f8ca-402e-8044-f9280bed1394] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:03.608239 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f24c056f-55ed-450c-b464-cacb6612fbf5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:03.608718 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f24c056f-55ed-450c-b464-cacb6612fbf5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:03.609150 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f24c056f-55ed-450c-b464-cacb6612fbf5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:03.609836 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f24c056f-55ed-450c-b464-cacb6612fbf5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:03.610281 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f24c056f-55ed-450c-b464-cacb6612fbf5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:03.610696 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f24c056f-55ed-450c-b464-cacb6612fbf5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:03.741018 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f24c056f-55ed-450c-b464-cacb6612fbf5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:03.748963 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f24c056f-55ed-450c-b464-cacb6612fbf5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394" status: 200 len: 1276 microversion: 2.1 time: 0.152225 Aug 17 08:50:03.749529 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 473/957] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:03 2022] GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394 => generated 1276 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:04.263779 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-68eac752-d127-48ff-93ed-d376722c2751 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:04.264385 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-68eac752-d127-48ff-93ed-d376722c2751 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] [instance: 156b3d66-a8ac-45d0-8355-1ca428279901] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:04.270452 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-68eac752-d127-48ff-93ed-d376722c2751 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:04.270924 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-68eac752-d127-48ff-93ed-d376722c2751 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:04.271352 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-68eac752-d127-48ff-93ed-d376722c2751 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:04.272051 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-68eac752-d127-48ff-93ed-d376722c2751 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:04.272503 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-68eac752-d127-48ff-93ed-d376722c2751 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:04.272917 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-68eac752-d127-48ff-93ed-d376722c2751 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:04.399285 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-68eac752-d127-48ff-93ed-d376722c2751 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a897aa2a6a4152b55446073a3ba858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e178d565fec4597a8089a7a6850d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:04.407282 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-68eac752-d127-48ff-93ed-d376722c2751 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] 10.222.0.15 "GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901" status: 200 len: 1314 microversion: 2.1 time: 0.147876 Aug 17 08:50:04.407879 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 485/958] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:04 2022] GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:04.769017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-730e5e14-420f-48a9-ba8e-632af6bc64fe tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:04.769621 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-730e5e14-420f-48a9-ba8e-632af6bc64fe tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: e4cef611-f8ca-402e-8044-f9280bed1394] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:04.776558 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-730e5e14-420f-48a9-ba8e-632af6bc64fe tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:04.777033 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-730e5e14-420f-48a9-ba8e-632af6bc64fe tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:04.777460 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-730e5e14-420f-48a9-ba8e-632af6bc64fe tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:04.778135 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-730e5e14-420f-48a9-ba8e-632af6bc64fe tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:04.778582 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-730e5e14-420f-48a9-ba8e-632af6bc64fe tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:04.778998 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-730e5e14-420f-48a9-ba8e-632af6bc64fe tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:04.904555 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-730e5e14-420f-48a9-ba8e-632af6bc64fe tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:04.911897 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-730e5e14-420f-48a9-ba8e-632af6bc64fe tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394" status: 200 len: 1276 microversion: 2.1 time: 0.146678 Aug 17 08:50:04.912454 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 474/959] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:04 2022] GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394 => generated 1276 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:05.429468 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-08330086-5c6c-4c97-9f04-e97d87f7e276 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:05.430165 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-08330086-5c6c-4c97-9f04-e97d87f7e276 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] [instance: 156b3d66-a8ac-45d0-8355-1ca428279901] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:05.437126 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-08330086-5c6c-4c97-9f04-e97d87f7e276 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:05.437604 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-08330086-5c6c-4c97-9f04-e97d87f7e276 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:05.438034 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-08330086-5c6c-4c97-9f04-e97d87f7e276 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:05.438721 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-08330086-5c6c-4c97-9f04-e97d87f7e276 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:05.439173 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-08330086-5c6c-4c97-9f04-e97d87f7e276 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:05.439610 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-08330086-5c6c-4c97-9f04-e97d87f7e276 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:05.585784 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-08330086-5c6c-4c97-9f04-e97d87f7e276 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a897aa2a6a4152b55446073a3ba858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e178d565fec4597a8089a7a6850d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:05.601040 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-08330086-5c6c-4c97-9f04-e97d87f7e276 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] 10.222.0.15 "GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901" status: 200 len: 1314 microversion: 2.1 time: 0.175647 Aug 17 08:50:05.602246 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 486/960] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:05 2022] GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:05.933517 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-3b6f20dd-3216-4892-ba8c-143470fba11b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:05.934139 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-3b6f20dd-3216-4892-ba8c-143470fba11b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: e4cef611-f8ca-402e-8044-f9280bed1394] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:05.940765 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3b6f20dd-3216-4892-ba8c-143470fba11b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:05.941265 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3b6f20dd-3216-4892-ba8c-143470fba11b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:05.941701 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3b6f20dd-3216-4892-ba8c-143470fba11b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:05.942409 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3b6f20dd-3216-4892-ba8c-143470fba11b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:05.942856 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3b6f20dd-3216-4892-ba8c-143470fba11b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:05.943281 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-3b6f20dd-3216-4892-ba8c-143470fba11b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:06.160905 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-3b6f20dd-3216-4892-ba8c-143470fba11b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:06.169379 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-3b6f20dd-3216-4892-ba8c-143470fba11b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394" status: 200 len: 1276 microversion: 2.1 time: 0.240314 Aug 17 08:50:06.169950 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 475/961] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:05 2022] GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394 => generated 1276 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:50:06.256165 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-e520a40f-d241-4434-ba8b-824c7321bd95 req-853d9b84-375b-425e-bd56-ec77a3f38920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4cef611-f8ca-402e-8044-f9280bed1394", "tag": "69036d79-fa79-42cb-a8a8-aa8291f62f95"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:50:06.265659 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-e520a40f-d241-4434-ba8b-824c7321bd95 req-853d9b84-375b-425e-bd56-ec77a3f38920 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:06.266248 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-e520a40f-d241-4434-ba8b-824c7321bd95 req-853d9b84-375b-425e-bd56-ec77a3f38920 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:06.266926 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-e520a40f-d241-4434-ba8b-824c7321bd95 req-853d9b84-375b-425e-bd56-ec77a3f38920 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:06.278536 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-e520a40f-d241-4434-ba8b-824c7321bd95 req-853d9b84-375b-425e-bd56-ec77a3f38920 service nova] Creating event network-changed:69036d79-fa79-42cb-a8a8-aa8291f62f95 for instance e4cef611-f8ca-402e-8044-f9280bed1394 on hv-cinder-85331 Aug 17 08:50:06.283391 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-e520a40f-d241-4434-ba8b-824c7321bd95 req-853d9b84-375b-425e-bd56-ec77a3f38920 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030950 Aug 17 08:50:06.284034 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 487/962] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:50:06.623355 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-58804f27-4fc9-4102-b791-9ac8ea9ffb26 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:06.623984 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-58804f27-4fc9-4102-b791-9ac8ea9ffb26 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] [instance: 156b3d66-a8ac-45d0-8355-1ca428279901] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:06.632962 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-58804f27-4fc9-4102-b791-9ac8ea9ffb26 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:06.633815 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-58804f27-4fc9-4102-b791-9ac8ea9ffb26 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:06.634777 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-58804f27-4fc9-4102-b791-9ac8ea9ffb26 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:06.636760 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-58804f27-4fc9-4102-b791-9ac8ea9ffb26 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:06.637485 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-58804f27-4fc9-4102-b791-9ac8ea9ffb26 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:06.638047 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-58804f27-4fc9-4102-b791-9ac8ea9ffb26 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:06.895358 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-58804f27-4fc9-4102-b791-9ac8ea9ffb26 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a897aa2a6a4152b55446073a3ba858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e178d565fec4597a8089a7a6850d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:06.903482 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-58804f27-4fc9-4102-b791-9ac8ea9ffb26 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] 10.222.0.15 "GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901" status: 200 len: 1314 microversion: 2.1 time: 0.284564 Aug 17 08:50:06.904325 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 476/963] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:06 2022] GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:07.192367 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-63de5e9e-1e59-4be0-ab89-7e7db543ef0a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:07.193372 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-63de5e9e-1e59-4be0-ab89-7e7db543ef0a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: e4cef611-f8ca-402e-8044-f9280bed1394] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:07.199857 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-63de5e9e-1e59-4be0-ab89-7e7db543ef0a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:07.200337 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-63de5e9e-1e59-4be0-ab89-7e7db543ef0a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:07.200760 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-63de5e9e-1e59-4be0-ab89-7e7db543ef0a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:07.201431 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-63de5e9e-1e59-4be0-ab89-7e7db543ef0a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:07.201875 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-63de5e9e-1e59-4be0-ab89-7e7db543ef0a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:07.202290 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-63de5e9e-1e59-4be0-ab89-7e7db543ef0a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:07.338990 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-63de5e9e-1e59-4be0-ab89-7e7db543ef0a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:07.346409 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-63de5e9e-1e59-4be0-ab89-7e7db543ef0a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394" status: 200 len: 1264 microversion: 2.1 time: 0.159963 Aug 17 08:50:07.346964 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 488/964] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:07 2022] GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:07.736696 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-ca09c08d-f388-417b-ad21-b6ac296a548a req-8941655b-4453-4c4b-b1e1-d4dbda041ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "156b3d66-a8ac-45d0-8355-1ca428279901", "name": "network-vif-plugged", "status": "completed", "tag": "400ef3e0-3b51-4e32-87fc-82b0b1ca97e2"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:50:07.744103 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=2 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:50:07.748449 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-ca09c08d-f388-417b-ad21-b6ac296a548a req-8941655b-4453-4c4b-b1e1-d4dbda041ed6 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:07.748922 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-ca09c08d-f388-417b-ad21-b6ac296a548a req-8941655b-4453-4c4b-b1e1-d4dbda041ed6 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:07.749341 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-ca09c08d-f388-417b-ad21-b6ac296a548a req-8941655b-4453-4c4b-b1e1-d4dbda041ed6 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:07.761612 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-ca09c08d-f388-417b-ad21-b6ac296a548a req-8941655b-4453-4c4b-b1e1-d4dbda041ed6 service nova] Creating event network-vif-plugged:400ef3e0-3b51-4e32-87fc-82b0b1ca97e2 for instance 156b3d66-a8ac-45d0-8355-1ca428279901 on hv-cinder-85331 Aug 17 08:50:07.766738 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-ca09c08d-f388-417b-ad21-b6ac296a548a req-8941655b-4453-4c4b-b1e1-d4dbda041ed6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033489 Aug 17 08:50:07.767328 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 477/965] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:50:07.924498 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4cf87249-c3ba-4b57-8e93-d8a2c91cba68 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:07.925105 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-4cf87249-c3ba-4b57-8e93-d8a2c91cba68 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] [instance: 156b3d66-a8ac-45d0-8355-1ca428279901] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:07.931678 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4cf87249-c3ba-4b57-8e93-d8a2c91cba68 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:07.932173 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4cf87249-c3ba-4b57-8e93-d8a2c91cba68 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:07.932614 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4cf87249-c3ba-4b57-8e93-d8a2c91cba68 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:07.933296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4cf87249-c3ba-4b57-8e93-d8a2c91cba68 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:07.933745 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4cf87249-c3ba-4b57-8e93-d8a2c91cba68 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:07.934163 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4cf87249-c3ba-4b57-8e93-d8a2c91cba68 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:08.063611 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-4cf87249-c3ba-4b57-8e93-d8a2c91cba68 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a897aa2a6a4152b55446073a3ba858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e178d565fec4597a8089a7a6850d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:08.071242 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4cf87249-c3ba-4b57-8e93-d8a2c91cba68 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] 10.222.0.15 "GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901" status: 200 len: 1314 microversion: 2.1 time: 0.150569 Aug 17 08:50:08.071956 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 489/966] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:07 2022] GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:08.367527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-f0ffd111-d9f7-4000-beee-4402e313c100 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:08.368140 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-f0ffd111-d9f7-4000-beee-4402e313c100 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: e4cef611-f8ca-402e-8044-f9280bed1394] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:08.374971 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f0ffd111-d9f7-4000-beee-4402e313c100 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:08.375443 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f0ffd111-d9f7-4000-beee-4402e313c100 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:08.375900 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f0ffd111-d9f7-4000-beee-4402e313c100 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:08.376573 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f0ffd111-d9f7-4000-beee-4402e313c100 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:08.377021 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f0ffd111-d9f7-4000-beee-4402e313c100 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:08.377437 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-f0ffd111-d9f7-4000-beee-4402e313c100 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:08.562211 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-f0ffd111-d9f7-4000-beee-4402e313c100 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:08.569646 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-f0ffd111-d9f7-4000-beee-4402e313c100 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394" status: 200 len: 1264 microversion: 2.1 time: 0.206476 Aug 17 08:50:08.570211 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 478/967] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:08 2022] GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394 => generated 1264 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:09.092974 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a0086178-cc9a-456c-a140-7eb4d473b5aa tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:09.093529 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a0086178-cc9a-456c-a140-7eb4d473b5aa tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] [instance: 156b3d66-a8ac-45d0-8355-1ca428279901] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:09.099856 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a0086178-cc9a-456c-a140-7eb4d473b5aa tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:09.100338 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a0086178-cc9a-456c-a140-7eb4d473b5aa tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:09.100772 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a0086178-cc9a-456c-a140-7eb4d473b5aa tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:09.101456 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a0086178-cc9a-456c-a140-7eb4d473b5aa tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:09.101908 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a0086178-cc9a-456c-a140-7eb4d473b5aa tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:09.102329 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a0086178-cc9a-456c-a140-7eb4d473b5aa tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:09.234578 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a0086178-cc9a-456c-a140-7eb4d473b5aa tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a897aa2a6a4152b55446073a3ba858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e178d565fec4597a8089a7a6850d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:09.242392 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a0086178-cc9a-456c-a140-7eb4d473b5aa tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] 10.222.0.15 "GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901" status: 200 len: 1314 microversion: 2.1 time: 0.153045 Aug 17 08:50:09.243095 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 490/968] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:09 2022] GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:50:09.558961 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 08:50:09.559213 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Wed Aug 17 08:50:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 08:50:09.591701 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-7f627468-9913-406c-a9c8-a2083741f155 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:09.592306 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-7f627468-9913-406c-a9c8-a2083741f155 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: e4cef611-f8ca-402e-8044-f9280bed1394] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:09.599124 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7f627468-9913-406c-a9c8-a2083741f155 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:09.599752 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7f627468-9913-406c-a9c8-a2083741f155 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:09.600188 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7f627468-9913-406c-a9c8-a2083741f155 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:09.600987 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7f627468-9913-406c-a9c8-a2083741f155 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:09.601438 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7f627468-9913-406c-a9c8-a2083741f155 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:09.601855 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-7f627468-9913-406c-a9c8-a2083741f155 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:09.740217 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-7f627468-9913-406c-a9c8-a2083741f155 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:09.748325 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-7f627468-9913-406c-a9c8-a2083741f155 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394" status: 200 len: 1264 microversion: 2.1 time: 0.160556 Aug 17 08:50:09.748886 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 479/969] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:09 2022] GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:10.266168 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-bade0202-b5c6-49ed-a848-4b893bdbe1a2 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:10.266772 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-bade0202-b5c6-49ed-a848-4b893bdbe1a2 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] [instance: 156b3d66-a8ac-45d0-8355-1ca428279901] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:10.273235 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bade0202-b5c6-49ed-a848-4b893bdbe1a2 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:10.273712 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bade0202-b5c6-49ed-a848-4b893bdbe1a2 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:10.274142 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bade0202-b5c6-49ed-a848-4b893bdbe1a2 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:10.275518 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bade0202-b5c6-49ed-a848-4b893bdbe1a2 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:10.275999 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bade0202-b5c6-49ed-a848-4b893bdbe1a2 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:10.276421 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bade0202-b5c6-49ed-a848-4b893bdbe1a2 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:10.401594 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-bade0202-b5c6-49ed-a848-4b893bdbe1a2 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a897aa2a6a4152b55446073a3ba858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e178d565fec4597a8089a7a6850d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:10.409025 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-bade0202-b5c6-49ed-a848-4b893bdbe1a2 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] 10.222.0.15 "GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901" status: 200 len: 1464 microversion: 2.1 time: 0.146781 Aug 17 08:50:10.409581 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 491/970] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:10 2022] GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901 => generated 1464 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:10.455696 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1aabcef9-e690-49ce-8190-e2365bcacd06 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:10.456196 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1aabcef9-e690-49ce-8190-e2365bcacd06 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] [instance: 156b3d66-a8ac-45d0-8355-1ca428279901] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:10.462039 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1aabcef9-e690-49ce-8190-e2365bcacd06 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:10.462526 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1aabcef9-e690-49ce-8190-e2365bcacd06 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:10.462961 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1aabcef9-e690-49ce-8190-e2365bcacd06 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:10.463676 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1aabcef9-e690-49ce-8190-e2365bcacd06 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:10.464138 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1aabcef9-e690-49ce-8190-e2365bcacd06 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:10.464552 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1aabcef9-e690-49ce-8190-e2365bcacd06 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:10.489426 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1aabcef9-e690-49ce-8190-e2365bcacd06 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] [instance: 156b3d66-a8ac-45d0-8355-1ca428279901] Going to try to terminate instance {{(pid=127298) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 08:50:10.570102 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1aabcef9-e690-49ce-8190-e2365bcacd06 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] 10.222.0.15 "DELETE /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901" status: 204 len: 0 microversion: 2.1 time: 0.117854 Aug 17 08:50:10.570999 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 480/971] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:50:10 2022] DELETE /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 08:50:10.581206 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-05cc8aca-10d7-4dfa-8229-49b198952e80 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:10.582072 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-05cc8aca-10d7-4dfa-8229-49b198952e80 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] [instance: 156b3d66-a8ac-45d0-8355-1ca428279901] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:10.588063 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-05cc8aca-10d7-4dfa-8229-49b198952e80 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:10.588614 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-05cc8aca-10d7-4dfa-8229-49b198952e80 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:10.589112 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-05cc8aca-10d7-4dfa-8229-49b198952e80 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:10.589866 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-05cc8aca-10d7-4dfa-8229-49b198952e80 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:10.590317 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-05cc8aca-10d7-4dfa-8229-49b198952e80 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:10.590739 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-05cc8aca-10d7-4dfa-8229-49b198952e80 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:10.725155 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-05cc8aca-10d7-4dfa-8229-49b198952e80 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a897aa2a6a4152b55446073a3ba858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e178d565fec4597a8089a7a6850d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:10.733500 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-05cc8aca-10d7-4dfa-8229-49b198952e80 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] 10.222.0.15 "GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901" status: 200 len: 1470 microversion: 2.1 time: 0.157727 Aug 17 08:50:10.734061 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 492/972] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:10 2022] GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:10.769058 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-13186d3a-91df-438e-9700-ddf9f86facd5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:10.769753 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-13186d3a-91df-438e-9700-ddf9f86facd5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: e4cef611-f8ca-402e-8044-f9280bed1394] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:10.776684 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-13186d3a-91df-438e-9700-ddf9f86facd5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:10.777210 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-13186d3a-91df-438e-9700-ddf9f86facd5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:10.777710 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-13186d3a-91df-438e-9700-ddf9f86facd5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:10.778519 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-13186d3a-91df-438e-9700-ddf9f86facd5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:10.779083 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-13186d3a-91df-438e-9700-ddf9f86facd5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:10.779569 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-13186d3a-91df-438e-9700-ddf9f86facd5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:10.936532 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-13186d3a-91df-438e-9700-ddf9f86facd5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:10.944182 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-13186d3a-91df-438e-9700-ddf9f86facd5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394" status: 200 len: 1264 microversion: 2.1 time: 0.179373 Aug 17 08:50:10.944760 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 481/973] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:10 2022] GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394 => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:11.755991 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-da0632c0-bce2-4e9c-b1d6-00ccacc44329 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:11.756591 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-da0632c0-bce2-4e9c-b1d6-00ccacc44329 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] [instance: 156b3d66-a8ac-45d0-8355-1ca428279901] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:11.758466 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:50:11.759932 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell0:SELECT=8 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:50:11.767585 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da0632c0-bce2-4e9c-b1d6-00ccacc44329 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:11.768076 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da0632c0-bce2-4e9c-b1d6-00ccacc44329 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:11.768523 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da0632c0-bce2-4e9c-b1d6-00ccacc44329 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:11.769196 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da0632c0-bce2-4e9c-b1d6-00ccacc44329 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:11.769642 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da0632c0-bce2-4e9c-b1d6-00ccacc44329 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:11.770060 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-da0632c0-bce2-4e9c-b1d6-00ccacc44329 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:11.910207 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-da0632c0-bce2-4e9c-b1d6-00ccacc44329 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a897aa2a6a4152b55446073a3ba858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e178d565fec4597a8089a7a6850d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:11.917668 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-da0632c0-bce2-4e9c-b1d6-00ccacc44329 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] 10.222.0.15 "GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901" status: 200 len: 1470 microversion: 2.1 time: 0.165699 Aug 17 08:50:11.918334 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 493/974] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:11 2022] GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901 => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:11.966710 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-e109303f-9a4b-41ea-a9bc-124102924746 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:11.967325 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-e109303f-9a4b-41ea-a9bc-124102924746 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: e4cef611-f8ca-402e-8044-f9280bed1394] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:11.969372 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell0:SELECT=8 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:50:11.974937 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e109303f-9a4b-41ea-a9bc-124102924746 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:11.975420 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e109303f-9a4b-41ea-a9bc-124102924746 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:11.975883 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e109303f-9a4b-41ea-a9bc-124102924746 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:11.976569 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e109303f-9a4b-41ea-a9bc-124102924746 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:11.977020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e109303f-9a4b-41ea-a9bc-124102924746 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:11.977438 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-e109303f-9a4b-41ea-a9bc-124102924746 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:12.113514 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-e109303f-9a4b-41ea-a9bc-124102924746 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:12.121377 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-e109303f-9a4b-41ea-a9bc-124102924746 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394" status: 200 len: 1264 microversion: 2.1 time: 0.159142 Aug 17 08:50:12.121948 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 482/975] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:11 2022] GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:12.642648 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-946fe498-7bbf-4392-ad05-3570d94c7e31 req-8e5c3542-b8e1-44b0-a9bf-c00d51f7c3f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "156b3d66-a8ac-45d0-8355-1ca428279901", "name": "network-vif-deleted", "tag": "400ef3e0-3b51-4e32-87fc-82b0b1ca97e2"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:50:12.652457 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-946fe498-7bbf-4392-ad05-3570d94c7e31 req-8e5c3542-b8e1-44b0-a9bf-c00d51f7c3f2 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:12.652935 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-946fe498-7bbf-4392-ad05-3570d94c7e31 req-8e5c3542-b8e1-44b0-a9bf-c00d51f7c3f2 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:12.653362 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-946fe498-7bbf-4392-ad05-3570d94c7e31 req-8e5c3542-b8e1-44b0-a9bf-c00d51f7c3f2 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:12.668627 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-946fe498-7bbf-4392-ad05-3570d94c7e31 req-8e5c3542-b8e1-44b0-a9bf-c00d51f7c3f2 service nova] Creating event network-vif-deleted:400ef3e0-3b51-4e32-87fc-82b0b1ca97e2 for instance 156b3d66-a8ac-45d0-8355-1ca428279901 on hv-cinder-85331 Aug 17 08:50:12.673797 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-946fe498-7bbf-4392-ad05-3570d94c7e31 req-8e5c3542-b8e1-44b0-a9bf-c00d51f7c3f2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034781 Aug 17 08:50:12.674414 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 494/976] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:50:12.940845 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-02a17058-e7ec-45b1-8ba1-b20a3c391f48 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:12.941448 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-02a17058-e7ec-45b1-8ba1-b20a3c391f48 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] [instance: 156b3d66-a8ac-45d0-8355-1ca428279901] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:12.947521 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02a17058-e7ec-45b1-8ba1-b20a3c391f48 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:12.948025 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02a17058-e7ec-45b1-8ba1-b20a3c391f48 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:12.948450 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02a17058-e7ec-45b1-8ba1-b20a3c391f48 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:12.949391 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02a17058-e7ec-45b1-8ba1-b20a3c391f48 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:12.949831 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02a17058-e7ec-45b1-8ba1-b20a3c391f48 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:12.950245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-02a17058-e7ec-45b1-8ba1-b20a3c391f48 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:13.014156 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-02a17058-e7ec-45b1-8ba1-b20a3c391f48 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a897aa2a6a4152b55446073a3ba858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e178d565fec4597a8089a7a6850d2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:13.022496 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-02a17058-e7ec-45b1-8ba1-b20a3c391f48 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] 10.222.0.15 "GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901" status: 200 len: 1299 microversion: 2.1 time: 0.085427 Aug 17 08:50:13.023075 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 483/977] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:12 2022] GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901 => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:13.263023 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-04d59a9d-0d3f-4c0e-b2a7-0d537885c5f7 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:13.263758 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-04d59a9d-0d3f-4c0e-b2a7-0d537885c5f7 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: e4cef611-f8ca-402e-8044-f9280bed1394] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:13.269920 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04d59a9d-0d3f-4c0e-b2a7-0d537885c5f7 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:13.270398 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04d59a9d-0d3f-4c0e-b2a7-0d537885c5f7 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:13.270834 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04d59a9d-0d3f-4c0e-b2a7-0d537885c5f7 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:13.271518 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04d59a9d-0d3f-4c0e-b2a7-0d537885c5f7 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:13.272000 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04d59a9d-0d3f-4c0e-b2a7-0d537885c5f7 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:13.272422 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-04d59a9d-0d3f-4c0e-b2a7-0d537885c5f7 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:13.408772 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-04d59a9d-0d3f-4c0e-b2a7-0d537885c5f7 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:13.416661 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-04d59a9d-0d3f-4c0e-b2a7-0d537885c5f7 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394" status: 200 len: 1264 microversion: 2.1 time: 0.279121 Aug 17 08:50:13.417246 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 495/978] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:13 2022] GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394 => generated 1264 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:14.044088 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-19a2f1ac-e8de-4fd7-b8a2-c131b4d20c06 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:14.044688 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-19a2f1ac-e8de-4fd7-b8a2-c131b4d20c06 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] [instance: 156b3d66-a8ac-45d0-8355-1ca428279901] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:14.051059 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-19a2f1ac-e8de-4fd7-b8a2-c131b4d20c06 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:14.051560 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-19a2f1ac-e8de-4fd7-b8a2-c131b4d20c06 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:14.052012 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-19a2f1ac-e8de-4fd7-b8a2-c131b4d20c06 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:14.052686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-19a2f1ac-e8de-4fd7-b8a2-c131b4d20c06 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:14.053141 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-19a2f1ac-e8de-4fd7-b8a2-c131b4d20c06 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:14.053561 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-19a2f1ac-e8de-4fd7-b8a2-c131b4d20c06 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:14.068145 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-19a2f1ac-e8de-4fd7-b8a2-c131b4d20c06 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] HTTP exception thrown: Instance 156b3d66-a8ac-45d0-8355-1ca428279901 could not be found. Aug 17 08:50:14.069829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-19a2f1ac-e8de-4fd7-b8a2-c131b4d20c06 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Request method failure captured: Aug 17 08:50:14.069829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901 HTTP/1.1 Aug 17 08:50:14.069829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:50:14.069829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:50:14.069829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:50:14.069829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:50:14.069829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:50:14.069829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:50:14.069829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:50:14.069829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:50:14.069829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_KuxgxU33sVnO6uly8SpVNo1LB1qRrhJ00sUghi51syQT-kf83pujjvUfskG4j-oJF0x3rzdRHNBA8vWGt4nzshyOjCnGqy5b8DBjVxcJTrDiug8-jeZPLyzsJSCnIZPntPSndfCNaYNrtWAY11VSFBf6znuEdIco_YUlNwxVnpeltU Aug 17 08:50:14.069829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:50:14.069829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:50:14.069829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:50:14.069829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:50:14.069829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:50:14.069829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:50:14.069829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: 2e178d565fec4597a8089a7a6850d2ab Aug 17 08:50:14.069829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-VolumesNegativeTest-337458330 Aug 17 08:50:14.069829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:50:14.069829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:50:14.071652 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2e178d565fec4597a8089a7a6850d2ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2e178d565fec4597a8089a7a6850d2ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2e178d565fec4597a8089a7a6850d2ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2e178d565fec4597a8089a7a6850d2ab", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:50:14.071652 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-VolumesNegativeTest-337458330 Aug 17 08:50:14.071652 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: 2e178d565fec4597a8089a7a6850d2ab Aug 17 08:50:14.071652 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-VolumesNegativeTest-337458330 Aug 17 08:50:14.071652 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-VolumesNegativeTest-337458330-project Aug 17 08:50:14.071652 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:50:14.071652 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:50:14.071652 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: a6a897aa2a6a4152b55446073a3ba858 Aug 17 08:50:14.071652 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-VolumesNegativeTest-337458330-project Aug 17 08:50:14.071652 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:50:14.071652 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Instance 156b3d66-a8ac-45d0-8355-1ca428279901 could not be found. Aug 17 08:50:14.071652 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'id': '156b3d66-a8ac-45d0-8355-1ca428279901'} Aug 17 08:50:14.072689 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:50:14.072689 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:50:14.072689 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:50:14.072689 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:50:14.072689 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:50:14.072689 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:50:14.072689 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:50:14.072689 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:50:14.072689 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:50:14.072689 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:50:14.072689 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 156b3d66-a8ac-45d0-8355-1ca428279901 could not be found. Aug 17 08:50:14.072689 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:50:14.072689 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:50:14.072689 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:50:14.072689 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:50:14.072689 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:50:14.072689 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:50:14.072689 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:50:14.072689 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:50:14.072689 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:50:14.074619 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:50:14.074619 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:50:14.074619 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:50:14.074619 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:50:14.074619 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:50:14.074619 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:50:14.074619 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:50:14.074619 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 156b3d66-a8ac-45d0-8355-1ca428279901 could not be found. Aug 17 08:50:14.074619 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:50:14.074619 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:50:14.074619 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:50:14.074619 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:50:14.074619 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:50:14.074619 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:50:14.074619 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:50:14.074619 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:50:14.074619 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 156b3d66-a8ac-45d0-8355-1ca428279901 could not be found. Aug 17 08:50:14.074619 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:50:14.076136 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-19a2f1ac-e8de-4fd7-b8a2-c131b4d20c06 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] Returning 404 to user: Instance 156b3d66-a8ac-45d0-8355-1ca428279901 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:50:14.076136 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-19a2f1ac-e8de-4fd7-b8a2-c131b4d20c06 tempest-VolumesNegativeTest-337458330 tempest-VolumesNegativeTest-337458330-project] 10.222.0.15 "GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901" status: 404 len: 111 microversion: 2.1 time: 0.031593 Aug 17 08:50:14.076136 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 484/979] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:14 2022] GET /compute/v2.1/servers/156b3d66-a8ac-45d0-8355-1ca428279901 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:50:14.436498 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4c5f15ff-212d-4321-95a6-fef930bf3176 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:14.437103 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-4c5f15ff-212d-4321-95a6-fef930bf3176 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: e4cef611-f8ca-402e-8044-f9280bed1394] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:14.443665 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4c5f15ff-212d-4321-95a6-fef930bf3176 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:14.444163 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4c5f15ff-212d-4321-95a6-fef930bf3176 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:14.444593 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4c5f15ff-212d-4321-95a6-fef930bf3176 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:14.445290 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4c5f15ff-212d-4321-95a6-fef930bf3176 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:14.445744 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4c5f15ff-212d-4321-95a6-fef930bf3176 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:14.446165 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4c5f15ff-212d-4321-95a6-fef930bf3176 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:14.596083 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-4c5f15ff-212d-4321-95a6-fef930bf3176 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:14.605205 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4c5f15ff-212d-4321-95a6-fef930bf3176 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394" status: 200 len: 1264 microversion: 2.1 time: 0.172639 Aug 17 08:50:14.613837 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 496/980] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:14 2022] GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:15.630778 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-86b18afa-abd3-48c3-a90f-765b4d505de0 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:15.631510 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-86b18afa-abd3-48c3-a90f-765b4d505de0 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: e4cef611-f8ca-402e-8044-f9280bed1394] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:15.637975 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86b18afa-abd3-48c3-a90f-765b4d505de0 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:15.638446 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86b18afa-abd3-48c3-a90f-765b4d505de0 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:15.638871 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86b18afa-abd3-48c3-a90f-765b4d505de0 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:15.639911 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86b18afa-abd3-48c3-a90f-765b4d505de0 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:15.640519 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86b18afa-abd3-48c3-a90f-765b4d505de0 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:15.641084 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-86b18afa-abd3-48c3-a90f-765b4d505de0 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:15.667657 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:50:15.806946 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-86b18afa-abd3-48c3-a90f-765b4d505de0 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:15.821325 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-86b18afa-abd3-48c3-a90f-765b4d505de0 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394" status: 200 len: 1264 microversion: 2.1 time: 0.194728 Aug 17 08:50:15.823341 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 485/981] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:15 2022] GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394 => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:16.844260 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-c1d4e357-03e8-4016-8144-8465257f6922 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:16.844914 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-c1d4e357-03e8-4016-8144-8465257f6922 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: e4cef611-f8ca-402e-8044-f9280bed1394] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:16.851300 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c1d4e357-03e8-4016-8144-8465257f6922 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:16.851864 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c1d4e357-03e8-4016-8144-8465257f6922 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:16.852242 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c1d4e357-03e8-4016-8144-8465257f6922 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:16.852924 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c1d4e357-03e8-4016-8144-8465257f6922 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:16.853368 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c1d4e357-03e8-4016-8144-8465257f6922 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:16.853781 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-c1d4e357-03e8-4016-8144-8465257f6922 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:16.982773 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-c1d4e357-03e8-4016-8144-8465257f6922 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:16.990224 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-c1d4e357-03e8-4016-8144-8465257f6922 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394" status: 200 len: 1264 microversion: 2.1 time: 0.149986 Aug 17 08:50:16.990788 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 497/982] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:16 2022] GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:17.761209 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-234fdf56-5d88-4a5e-9524-38e47dca0015 req-dac68d5a-0030-4b84-baeb-44bc663c2a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4cef611-f8ca-402e-8044-f9280bed1394", "name": "network-vif-plugged", "status": "completed", "tag": "69036d79-fa79-42cb-a8a8-aa8291f62f95"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:50:17.771981 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-234fdf56-5d88-4a5e-9524-38e47dca0015 req-dac68d5a-0030-4b84-baeb-44bc663c2a49 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:17.772462 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-234fdf56-5d88-4a5e-9524-38e47dca0015 req-dac68d5a-0030-4b84-baeb-44bc663c2a49 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:17.772892 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-234fdf56-5d88-4a5e-9524-38e47dca0015 req-dac68d5a-0030-4b84-baeb-44bc663c2a49 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:17.789352 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-234fdf56-5d88-4a5e-9524-38e47dca0015 req-dac68d5a-0030-4b84-baeb-44bc663c2a49 service nova] Creating event network-vif-plugged:69036d79-fa79-42cb-a8a8-aa8291f62f95 for instance e4cef611-f8ca-402e-8044-f9280bed1394 on hv-cinder-85331 Aug 17 08:50:17.794297 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-234fdf56-5d88-4a5e-9524-38e47dca0015 req-dac68d5a-0030-4b84-baeb-44bc663c2a49 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037249 Aug 17 08:50:17.795077 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 486/983] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:50:18.011867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-4db2c52b-dd6a-4e28-af31-9b1daae2a17d tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:18.012458 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-4db2c52b-dd6a-4e28-af31-9b1daae2a17d tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: e4cef611-f8ca-402e-8044-f9280bed1394] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:18.019832 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4db2c52b-dd6a-4e28-af31-9b1daae2a17d tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:18.020319 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4db2c52b-dd6a-4e28-af31-9b1daae2a17d tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:18.020876 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4db2c52b-dd6a-4e28-af31-9b1daae2a17d tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:18.021428 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4db2c52b-dd6a-4e28-af31-9b1daae2a17d tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:18.022519 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4db2c52b-dd6a-4e28-af31-9b1daae2a17d tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:18.022949 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-4db2c52b-dd6a-4e28-af31-9b1daae2a17d tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:18.174187 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-4db2c52b-dd6a-4e28-af31-9b1daae2a17d tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:18.182635 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-4db2c52b-dd6a-4e28-af31-9b1daae2a17d tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394" status: 200 len: 1264 microversion: 2.1 time: 0.175192 Aug 17 08:50:18.183198 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 498/984] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:18 2022] GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:19.205513 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-d16eb0c1-2e3e-46a0-8c05-361497c43395 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:19.206195 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-d16eb0c1-2e3e-46a0-8c05-361497c43395 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: e4cef611-f8ca-402e-8044-f9280bed1394] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:19.213235 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d16eb0c1-2e3e-46a0-8c05-361497c43395 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:19.213704 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d16eb0c1-2e3e-46a0-8c05-361497c43395 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:19.214156 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d16eb0c1-2e3e-46a0-8c05-361497c43395 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:19.214829 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d16eb0c1-2e3e-46a0-8c05-361497c43395 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:19.215268 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d16eb0c1-2e3e-46a0-8c05-361497c43395 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:19.215762 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-d16eb0c1-2e3e-46a0-8c05-361497c43395 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:19.353712 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-d16eb0c1-2e3e-46a0-8c05-361497c43395 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:19.361054 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-d16eb0c1-2e3e-46a0-8c05-361497c43395 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394" status: 200 len: 1451 microversion: 2.1 time: 0.159839 Aug 17 08:50:19.361595 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 487/985] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:19 2022] GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:19.382277 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-a629f7a4-033f-4940-aba5-bbff0d8c3d3a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:50:19.382910 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-a629f7a4-033f-4940-aba5-bbff0d8c3d3a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: e4cef611-f8ca-402e-8044-f9280bed1394] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:50:19.389392 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a629f7a4-033f-4940-aba5-bbff0d8c3d3a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:19.389873 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a629f7a4-033f-4940-aba5-bbff0d8c3d3a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:19.390307 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a629f7a4-033f-4940-aba5-bbff0d8c3d3a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:19.390987 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a629f7a4-033f-4940-aba5-bbff0d8c3d3a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:19.391436 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a629f7a4-033f-4940-aba5-bbff0d8c3d3a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:19.391886 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-a629f7a4-033f-4940-aba5-bbff0d8c3d3a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:19.409636 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=100 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:50:19.523417 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-a629f7a4-033f-4940-aba5-bbff0d8c3d3a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:50:19.530954 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-a629f7a4-033f-4940-aba5-bbff0d8c3d3a tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394" status: 200 len: 1451 microversion: 2.1 time: 0.152561 Aug 17 08:50:19.531518 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 499/986] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:50:19 2022] GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:50:21.385023 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-fd1e807f-ec83-461a-9d60-db618e8a0d6d req-b4d04aa5-dca9-4103-8554-2cb58eb735b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4cef611-f8ca-402e-8044-f9280bed1394", "tag": "69036d79-fa79-42cb-a8a8-aa8291f62f95"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:50:21.395911 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-fd1e807f-ec83-461a-9d60-db618e8a0d6d req-b4d04aa5-dca9-4103-8554-2cb58eb735b8 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:50:21.396760 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-fd1e807f-ec83-461a-9d60-db618e8a0d6d req-b4d04aa5-dca9-4103-8554-2cb58eb735b8 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:50:21.397186 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-fd1e807f-ec83-461a-9d60-db618e8a0d6d req-b4d04aa5-dca9-4103-8554-2cb58eb735b8 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:50:21.409115 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-fd1e807f-ec83-461a-9d60-db618e8a0d6d req-b4d04aa5-dca9-4103-8554-2cb58eb735b8 service nova] Creating event network-changed:69036d79-fa79-42cb-a8a8-aa8291f62f95 for instance e4cef611-f8ca-402e-8044-f9280bed1394 on hv-cinder-85331 Aug 17 08:50:21.414169 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-fd1e807f-ec83-461a-9d60-db618e8a0d6d req-b4d04aa5-dca9-4103-8554-2cb58eb735b8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032729 Aug 17 08:50:21.414784 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 488/987] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:51:49.448699 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:51:49.450053 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG dbcounter [-] [127297] Writing DB stats nova_cell1:SELECT=2 {{(pid=127297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:51:49.453874 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR oslo.messaging._drivers.impl_rabbit [-] [98eabd8a-658f-4aca-960e-89bef0de4094] AMQP server on 10.222.0.15:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 17 08:51:49.454527 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:51:49.454651 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-0580138f-77c8-46e5-a00f-53ebd431c425 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:51:49.455104 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0580138f-77c8-46e5-a00f-53ebd431c425 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: e4cef611-f8ca-402e-8044-f9280bed1394] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:51:49.455275 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG dbcounter [-] [127298] Writing DB stats nova_cell1:SELECT=12 {{(pid=127298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 08:51:49.459936 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-dfcd6a2b-de6c-4233-ac58-fba823c600d0 req-0cff11fc-3002-473e-a254-c7027bb90cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4cef611-f8ca-402e-8044-f9280bed1394", "tag": "69036d79-fa79-42cb-a8a8-aa8291f62f95"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:51:49.462875 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0580138f-77c8-46e5-a00f-53ebd431c425 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:51:49.463666 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0580138f-77c8-46e5-a00f-53ebd431c425 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:51:49.464194 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0580138f-77c8-46e5-a00f-53ebd431c425 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:51:49.465617 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0580138f-77c8-46e5-a00f-53ebd431c425 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:51:49.466143 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0580138f-77c8-46e5-a00f-53ebd431c425 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:51:49.466641 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-0580138f-77c8-46e5-a00f-53ebd431c425 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:51:49.475464 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-dfcd6a2b-de6c-4233-ac58-fba823c600d0 req-0cff11fc-3002-473e-a254-c7027bb90cc8 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:51:49.475997 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-dfcd6a2b-de6c-4233-ac58-fba823c600d0 req-0cff11fc-3002-473e-a254-c7027bb90cc8 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:51:49.477061 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-dfcd6a2b-de6c-4233-ac58-fba823c600d0 req-0cff11fc-3002-473e-a254-c7027bb90cc8 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:51:49.491136 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-dfcd6a2b-de6c-4233-ac58-fba823c600d0 req-0cff11fc-3002-473e-a254-c7027bb90cc8 service nova] Creating event network-changed:69036d79-fa79-42cb-a8a8-aa8291f62f95 for instance e4cef611-f8ca-402e-8044-f9280bed1394 on hv-cinder-85331 Aug 17 08:51:49.492181 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-0580138f-77c8-46e5-a00f-53ebd431c425 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: e4cef611-f8ca-402e-8044-f9280bed1394] Going to try to terminate instance {{(pid=127297) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 08:51:49.497983 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-dfcd6a2b-de6c-4233-ac58-fba823c600d0 req-0cff11fc-3002-473e-a254-c7027bb90cc8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047385 Aug 17 08:51:49.498929 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 489/988] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:51:49.582128 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-0580138f-77c8-46e5-a00f-53ebd431c425 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394" status: 204 len: 0 microversion: 2.1 time: 0.134385 Aug 17 08:51:49.582839 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 500/989] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:51:49 2022] DELETE /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 08:51:49.593906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1192a8f8-0d8e-4dcb-b33a-e84d69f37ad5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:51:49.595235 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-1192a8f8-0d8e-4dcb-b33a-e84d69f37ad5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: e4cef611-f8ca-402e-8044-f9280bed1394] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:51:49.602366 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1192a8f8-0d8e-4dcb-b33a-e84d69f37ad5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:51:49.603020 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1192a8f8-0d8e-4dcb-b33a-e84d69f37ad5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:51:49.603746 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1192a8f8-0d8e-4dcb-b33a-e84d69f37ad5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:51:49.606796 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1192a8f8-0d8e-4dcb-b33a-e84d69f37ad5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:51:49.607614 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1192a8f8-0d8e-4dcb-b33a-e84d69f37ad5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:51:49.608421 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-1192a8f8-0d8e-4dcb-b33a-e84d69f37ad5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:51:49.753842 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-1192a8f8-0d8e-4dcb-b33a-e84d69f37ad5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:51:49.767914 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1192a8f8-0d8e-4dcb-b33a-e84d69f37ad5 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394" status: 200 len: 1576 microversion: 2.1 time: 0.179770 Aug 17 08:51:49.769069 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 490/990] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:51:49 2022] GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:51:50.789260 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-3df90178-1427-4943-ba80-1a3f4e8d9052 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:51:50.789907 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-3df90178-1427-4943-ba80-1a3f4e8d9052 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: e4cef611-f8ca-402e-8044-f9280bed1394] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:51:50.796387 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3df90178-1427-4943-ba80-1a3f4e8d9052 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:51:50.796870 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3df90178-1427-4943-ba80-1a3f4e8d9052 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:51:50.797304 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3df90178-1427-4943-ba80-1a3f4e8d9052 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:51:50.797988 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3df90178-1427-4943-ba80-1a3f4e8d9052 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:51:50.798442 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3df90178-1427-4943-ba80-1a3f4e8d9052 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:51:50.798867 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-3df90178-1427-4943-ba80-1a3f4e8d9052 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:51:50.929662 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-3df90178-1427-4943-ba80-1a3f4e8d9052 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:51:50.937614 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-3df90178-1427-4943-ba80-1a3f4e8d9052 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394" status: 200 len: 1576 microversion: 2.1 time: 0.152673 Aug 17 08:51:50.938187 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 501/991] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:51:50 2022] GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 08:51:51.959642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-0ed71731-9ce4-47f5-a579-72c23b2637d8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:51:51.960275 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-0ed71731-9ce4-47f5-a579-72c23b2637d8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: e4cef611-f8ca-402e-8044-f9280bed1394] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:51:51.970808 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0ed71731-9ce4-47f5-a579-72c23b2637d8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:51:51.971370 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0ed71731-9ce4-47f5-a579-72c23b2637d8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:51:51.971891 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0ed71731-9ce4-47f5-a579-72c23b2637d8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:51:51.972573 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0ed71731-9ce4-47f5-a579-72c23b2637d8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:51:51.973017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0ed71731-9ce4-47f5-a579-72c23b2637d8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:51:51.973433 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-0ed71731-9ce4-47f5-a579-72c23b2637d8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:51:51.989759 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO oslo.messaging._drivers.impl_rabbit [-] [98eabd8a-658f-4aca-960e-89bef0de4094] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 58238. Aug 17 08:51:52.177245 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-0ed71731-9ce4-47f5-a579-72c23b2637d8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:51:52.185145 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-0ed71731-9ce4-47f5-a579-72c23b2637d8 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394" status: 200 len: 1457 microversion: 2.1 time: 0.229319 Aug 17 08:51:52.185872 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 491/992] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:51:51 2022] GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394 => generated 1457 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:51:52.234502 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-03d326b4-2010-48d9-ab55-1f25fa6b96ea req-5b533e8f-f6d3-4ed8-838b-b88c231f6463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4cef611-f8ca-402e-8044-f9280bed1394", "name": "network-vif-deleted", "tag": "69036d79-fa79-42cb-a8a8-aa8291f62f95"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:51:52.244346 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-03d326b4-2010-48d9-ab55-1f25fa6b96ea req-5b533e8f-f6d3-4ed8-838b-b88c231f6463 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:51:52.244818 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-03d326b4-2010-48d9-ab55-1f25fa6b96ea req-5b533e8f-f6d3-4ed8-838b-b88c231f6463 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:51:52.245245 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-03d326b4-2010-48d9-ab55-1f25fa6b96ea req-5b533e8f-f6d3-4ed8-838b-b88c231f6463 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:51:52.260602 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-03d326b4-2010-48d9-ab55-1f25fa6b96ea req-5b533e8f-f6d3-4ed8-838b-b88c231f6463 service nova] Creating event network-vif-deleted:69036d79-fa79-42cb-a8a8-aa8291f62f95 for instance e4cef611-f8ca-402e-8044-f9280bed1394 on hv-cinder-85331 Aug 17 08:51:52.266122 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-03d326b4-2010-48d9-ab55-1f25fa6b96ea req-5b533e8f-f6d3-4ed8-838b-b88c231f6463 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035250 Aug 17 08:51:52.267026 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 502/993] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:51:53.206663 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-90ef5a7b-ec15-46e4-a2b6-e4744a699254 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:51:53.207241 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-90ef5a7b-ec15-46e4-a2b6-e4744a699254 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: e4cef611-f8ca-402e-8044-f9280bed1394] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:51:53.213544 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-90ef5a7b-ec15-46e4-a2b6-e4744a699254 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:51:53.214017 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-90ef5a7b-ec15-46e4-a2b6-e4744a699254 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:51:53.214442 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-90ef5a7b-ec15-46e4-a2b6-e4744a699254 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:51:53.215111 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-90ef5a7b-ec15-46e4-a2b6-e4744a699254 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:51:53.215573 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-90ef5a7b-ec15-46e4-a2b6-e4744a699254 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:51:53.215993 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-90ef5a7b-ec15-46e4-a2b6-e4744a699254 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:51:53.228893 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-90ef5a7b-ec15-46e4-a2b6-e4744a699254 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] HTTP exception thrown: Instance e4cef611-f8ca-402e-8044-f9280bed1394 could not be found. Aug 17 08:51:53.230926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-90ef5a7b-ec15-46e4-a2b6-e4744a699254 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Request method failure captured: Aug 17 08:51:53.230926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394 HTTP/1.1 Aug 17 08:51:53.230926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:51:53.230926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:51:53.230926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:51:53.230926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:51:53.230926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:51:53.230926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:51:53.230926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:51:53.230926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:51:53.230926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_KqTOZHHp4exlO9JtJvsxhU-XYqXYc5SttvczNE_w4p59bh8OCi-5xACSgv1RbctOsIDt0kRSJzjpMlFSNXzpcJeMw2-2JfJKowdfVi05mnPbRPopenh1uAbG4FQG04MtNjR4cEOuEtLzb5kdwyG7jCh6ueGti39sT6TwiusrQr38WM Aug 17 08:51:53.230926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:51:53.230926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:51:53.230926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:51:53.230926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:51:53.230926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:51:53.230926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:51:53.230926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: e2604417eb5f48f0b026b00a9c164e08 Aug 17 08:51:53.230926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-TestVolumeBootPattern-1304915916 Aug 17 08:51:53.230926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:51:53.230926 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:51:53.232728 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e2604417eb5f48f0b026b00a9c164e08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e2604417eb5f48f0b026b00a9c164e08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e2604417eb5f48f0b026b00a9c164e08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e2604417eb5f48f0b026b00a9c164e08", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:51:53.232728 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-TestVolumeBootPattern-1304915916 Aug 17 08:51:53.232728 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: e2604417eb5f48f0b026b00a9c164e08 Aug 17 08:51:53.232728 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-TestVolumeBootPattern-1304915916 Aug 17 08:51:53.232728 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-TestVolumeBootPattern-1304915916-project Aug 17 08:51:53.232728 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:51:53.232728 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:51:53.232728 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: 73a4f1987dda43068520217d36d99799 Aug 17 08:51:53.232728 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-TestVolumeBootPattern-1304915916-project Aug 17 08:51:53.232728 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:51:53.232728 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Instance e4cef611-f8ca-402e-8044-f9280bed1394 could not be found. Aug 17 08:51:53.232728 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'id': 'e4cef611-f8ca-402e-8044-f9280bed1394'} Aug 17 08:51:53.233806 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:51:53.233806 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:51:53.233806 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:51:53.233806 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:51:53.233806 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:51:53.233806 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:51:53.233806 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:51:53.233806 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:51:53.233806 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:51:53.233806 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:51:53.233806 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4cef611-f8ca-402e-8044-f9280bed1394 could not be found. Aug 17 08:51:53.233806 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:51:53.233806 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:51:53.233806 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:51:53.233806 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:51:53.233806 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:51:53.233806 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:51:53.233806 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:51:53.233806 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:51:53.233806 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:51:53.235478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:51:53.235478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:51:53.235478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:51:53.235478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:51:53.235478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:51:53.235478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:51:53.235478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:51:53.235478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4cef611-f8ca-402e-8044-f9280bed1394 could not be found. Aug 17 08:51:53.235478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:51:53.235478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:51:53.235478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:51:53.235478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:51:53.235478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:51:53.235478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:51:53.235478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:51:53.235478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:51:53.235478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4cef611-f8ca-402e-8044-f9280bed1394 could not be found. Aug 17 08:51:53.235478 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:51:53.237147 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-90ef5a7b-ec15-46e4-a2b6-e4744a699254 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Returning 404 to user: Instance e4cef611-f8ca-402e-8044-f9280bed1394 could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:51:53.237147 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-90ef5a7b-ec15-46e4-a2b6-e4744a699254 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394" status: 404 len: 111 microversion: 2.1 time: 0.029509 Aug 17 08:51:53.237147 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 492/994] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:51:53 2022] GET /compute/v2.1/servers/e4cef611-f8ca-402e-8044-f9280bed1394 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:51:56.272083 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-fb1a251d-88da-4e82-97e8-1eca108c774f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:51:56.273489 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fb1a251d-88da-4e82-97e8-1eca108c774f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 722b88a8-8b51-445c-905e-8184f2411d12] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:51:56.280896 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fb1a251d-88da-4e82-97e8-1eca108c774f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:51:56.281665 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fb1a251d-88da-4e82-97e8-1eca108c774f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:51:56.282334 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fb1a251d-88da-4e82-97e8-1eca108c774f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:51:56.283284 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fb1a251d-88da-4e82-97e8-1eca108c774f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:51:56.284145 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fb1a251d-88da-4e82-97e8-1eca108c774f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:51:56.284858 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-fb1a251d-88da-4e82-97e8-1eca108c774f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:51:56.313247 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-fb1a251d-88da-4e82-97e8-1eca108c774f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 722b88a8-8b51-445c-905e-8184f2411d12] Going to try to terminate instance {{(pid=127297) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 08:51:56.406292 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-fb1a251d-88da-4e82-97e8-1eca108c774f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "DELETE /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12" status: 204 len: 0 microversion: 2.1 time: 0.139055 Aug 17 08:51:56.406891 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 503/995] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:51:56 2022] DELETE /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 08:51:56.415825 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-95d28535-17f9-4f6f-9fdf-8c0196df963b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:51:56.416517 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-95d28535-17f9-4f6f-9fdf-8c0196df963b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 722b88a8-8b51-445c-905e-8184f2411d12] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:51:56.422927 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95d28535-17f9-4f6f-9fdf-8c0196df963b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:51:56.423411 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95d28535-17f9-4f6f-9fdf-8c0196df963b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:51:56.423887 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95d28535-17f9-4f6f-9fdf-8c0196df963b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:51:56.424555 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95d28535-17f9-4f6f-9fdf-8c0196df963b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:51:56.425174 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95d28535-17f9-4f6f-9fdf-8c0196df963b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:51:56.425595 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-95d28535-17f9-4f6f-9fdf-8c0196df963b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:51:56.487860 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [req-103e0a4e-ebf4-4683-a3f4-5f5f74b68b81 req-e5a716d9-bc39-4b40-a7bd-4e8260546bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "722b88a8-8b51-445c-905e-8184f2411d12", "tag": "9fc7feb5-24f5-44ed-95e0-b35c8999de23"}]} {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:51:56.497642 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-103e0a4e-ebf4-4683-a3f4-5f5f74b68b81 req-e5a716d9-bc39-4b40-a7bd-4e8260546bc2 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:51:56.498124 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-103e0a4e-ebf4-4683-a3f4-5f5f74b68b81 req-e5a716d9-bc39-4b40-a7bd-4e8260546bc2 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:51:56.498681 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [req-103e0a4e-ebf4-4683-a3f4-5f5f74b68b81 req-e5a716d9-bc39-4b40-a7bd-4e8260546bc2 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:51:56.512906 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.compute.server_external_events [req-103e0a4e-ebf4-4683-a3f4-5f5f74b68b81 req-e5a716d9-bc39-4b40-a7bd-4e8260546bc2 service nova] Creating event network-changed:9fc7feb5-24f5-44ed-95e0-b35c8999de23 for instance 722b88a8-8b51-445c-905e-8184f2411d12 on hv-cinder-85331 Aug 17 08:51:56.517735 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [req-103e0a4e-ebf4-4683-a3f4-5f5f74b68b81 req-e5a716d9-bc39-4b40-a7bd-4e8260546bc2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.248685 Aug 17 08:51:56.518794 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 493/996] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 08:51:56.569754 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.policy [None req-95d28535-17f9-4f6f-9fdf-8c0196df963b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127297) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:51:56.577565 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-95d28535-17f9-4f6f-9fdf-8c0196df963b tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12" status: 200 len: 1576 microversion: 2.1 time: 0.165858 Aug 17 08:51:56.584853 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 504/997] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:51:56 2022] GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:51:57.599431 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-110ddeb0-9f7d-43ab-9e17-e48ddf912f66 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:51:57.600187 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-110ddeb0-9f7d-43ab-9e17-e48ddf912f66 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 722b88a8-8b51-445c-905e-8184f2411d12] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:51:57.606831 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-110ddeb0-9f7d-43ab-9e17-e48ddf912f66 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:51:57.607323 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-110ddeb0-9f7d-43ab-9e17-e48ddf912f66 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:51:57.607782 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-110ddeb0-9f7d-43ab-9e17-e48ddf912f66 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:51:57.608467 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-110ddeb0-9f7d-43ab-9e17-e48ddf912f66 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:51:57.608915 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-110ddeb0-9f7d-43ab-9e17-e48ddf912f66 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:51:57.609739 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-110ddeb0-9f7d-43ab-9e17-e48ddf912f66 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:51:57.793995 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-110ddeb0-9f7d-43ab-9e17-e48ddf912f66 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:51:57.801408 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-110ddeb0-9f7d-43ab-9e17-e48ddf912f66 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12" status: 200 len: 1576 microversion: 2.1 time: 0.206688 Aug 17 08:51:57.801970 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 494/998] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:51:57 2022] GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12 => generated 1576 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:51:58.667347 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [req-33643a05-f669-4023-9c12-9616c2831656 req-6295b5dc-4014-4008-9770-cab0e2eea126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "722b88a8-8b51-445c-905e-8184f2411d12", "name": "network-vif-deleted", "tag": "9fc7feb5-24f5-44ed-95e0-b35c8999de23"}]} {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 08:51:58.678228 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-33643a05-f669-4023-9c12-9616c2831656 req-6295b5dc-4014-4008-9770-cab0e2eea126 service nova] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:51:58.678704 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-33643a05-f669-4023-9c12-9616c2831656 req-6295b5dc-4014-4008-9770-cab0e2eea126 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:51:58.679133 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [req-33643a05-f669-4023-9c12-9616c2831656 req-6295b5dc-4014-4008-9770-cab0e2eea126 service nova] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:51:58.691440 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.compute.server_external_events [req-33643a05-f669-4023-9c12-9616c2831656 req-6295b5dc-4014-4008-9770-cab0e2eea126 service nova] Creating event network-vif-deleted:9fc7feb5-24f5-44ed-95e0-b35c8999de23 for instance 722b88a8-8b51-445c-905e-8184f2411d12 on hv-cinder-85331 Aug 17 08:51:58.697186 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [req-33643a05-f669-4023-9c12-9616c2831656 req-6295b5dc-4014-4008-9770-cab0e2eea126 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033188 Aug 17 08:51:58.697825 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 505/999] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 08:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 08:51:58.822181 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-24ae8e6e-3a48-4ca7-8c3b-c6935d501381 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:51:58.822801 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-24ae8e6e-3a48-4ca7-8c3b-c6935d501381 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 722b88a8-8b51-445c-905e-8184f2411d12] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:51:58.830121 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-24ae8e6e-3a48-4ca7-8c3b-c6935d501381 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:51:58.830592 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-24ae8e6e-3a48-4ca7-8c3b-c6935d501381 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:51:58.831019 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-24ae8e6e-3a48-4ca7-8c3b-c6935d501381 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:51:58.831728 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-24ae8e6e-3a48-4ca7-8c3b-c6935d501381 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:51:58.832177 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-24ae8e6e-3a48-4ca7-8c3b-c6935d501381 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:51:58.832589 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-24ae8e6e-3a48-4ca7-8c3b-c6935d501381 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:51:58.892852 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.policy [None req-24ae8e6e-3a48-4ca7-8c3b-c6935d501381 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a4f1987dda43068520217d36d99799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2604417eb5f48f0b026b00a9c164e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127298) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 08:51:58.900241 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-24ae8e6e-3a48-4ca7-8c3b-c6935d501381 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12" status: 200 len: 1225 microversion: 2.1 time: 0.081892 Aug 17 08:51:58.900779 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 495/1000] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:51:58 2022] GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 08:51:59.920987 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-bcea853b-17be-413b-9735-4e17feb93a5e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:51:59.921671 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-bcea853b-17be-413b-9735-4e17feb93a5e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 722b88a8-8b51-445c-905e-8184f2411d12] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:51:59.928349 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcea853b-17be-413b-9735-4e17feb93a5e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:51:59.928832 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcea853b-17be-413b-9735-4e17feb93a5e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:51:59.929247 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcea853b-17be-413b-9735-4e17feb93a5e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:51:59.929946 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcea853b-17be-413b-9735-4e17feb93a5e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:51:59.930389 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcea853b-17be-413b-9735-4e17feb93a5e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:51:59.930805 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-bcea853b-17be-413b-9735-4e17feb93a5e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:51:59.943730 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-bcea853b-17be-413b-9735-4e17feb93a5e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] HTTP exception thrown: Instance 722b88a8-8b51-445c-905e-8184f2411d12 could not be found. Aug 17 08:51:59.945296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-bcea853b-17be-413b-9735-4e17feb93a5e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Request method failure captured: Aug 17 08:51:59.945296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12 HTTP/1.1 Aug 17 08:51:59.945296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:51:59.945296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:51:59.945296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:51:59.945296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:51:59.945296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:51:59.945296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:51:59.945296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:51:59.945296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:51:59.945296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_KqTOZHHp4exlO9JtJvsxhU-XYqXYc5SttvczNE_w4p59bh8OCi-5xACSgv1RbctOsIDt0kRSJzjpMlFSNXzpcJeMw2-2JfJKowdfVi05mnPbRPopenh1uAbG4FQG04MtNjR4cEOuEtLzb5kdwyG7jCh6ueGti39sT6TwiusrQr38WM Aug 17 08:51:59.945296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:51:59.945296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:51:59.945296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:51:59.945296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:51:59.945296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:51:59.945296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:51:59.945296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: e2604417eb5f48f0b026b00a9c164e08 Aug 17 08:51:59.945296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-TestVolumeBootPattern-1304915916 Aug 17 08:51:59.945296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:51:59.945296 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:51:59.947040 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e2604417eb5f48f0b026b00a9c164e08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e2604417eb5f48f0b026b00a9c164e08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e2604417eb5f48f0b026b00a9c164e08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e2604417eb5f48f0b026b00a9c164e08", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:51:59.947040 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-TestVolumeBootPattern-1304915916 Aug 17 08:51:59.947040 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: e2604417eb5f48f0b026b00a9c164e08 Aug 17 08:51:59.947040 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-TestVolumeBootPattern-1304915916 Aug 17 08:51:59.947040 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-TestVolumeBootPattern-1304915916-project Aug 17 08:51:59.947040 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:51:59.947040 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:51:59.947040 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: 73a4f1987dda43068520217d36d99799 Aug 17 08:51:59.947040 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-TestVolumeBootPattern-1304915916-project Aug 17 08:51:59.947040 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: > Aug 17 08:51:59.947040 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Instance 722b88a8-8b51-445c-905e-8184f2411d12 could not be found. Aug 17 08:51:59.947040 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': '722b88a8-8b51-445c-905e-8184f2411d12'} Aug 17 08:51:59.947957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:51:59.947957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:51:59.947957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:51:59.947957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:51:59.947957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:51:59.947957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:51:59.947957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:51:59.947957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:51:59.947957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:51:59.947957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:51:59.947957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 722b88a8-8b51-445c-905e-8184f2411d12 could not be found. Aug 17 08:51:59.947957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:51:59.947957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:51:59.947957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:51:59.947957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:51:59.947957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:51:59.947957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:51:59.947957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:51:59.947957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:51:59.947957 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:51:59.949870 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:51:59.949870 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:51:59.949870 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:51:59.949870 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:51:59.949870 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:51:59.949870 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:51:59.949870 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:51:59.949870 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 722b88a8-8b51-445c-905e-8184f2411d12 could not be found. Aug 17 08:51:59.949870 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:51:59.949870 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:51:59.949870 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:51:59.949870 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:51:59.949870 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:51:59.949870 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:51:59.949870 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:51:59.949870 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:51:59.949870 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 722b88a8-8b51-445c-905e-8184f2411d12 could not be found. Aug 17 08:51:59.949870 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:51:59.951485 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-bcea853b-17be-413b-9735-4e17feb93a5e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Returning 404 to user: Instance 722b88a8-8b51-445c-905e-8184f2411d12 could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:51:59.951485 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-bcea853b-17be-413b-9735-4e17feb93a5e tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12" status: 404 len: 111 microversion: 2.1 time: 0.029952 Aug 17 08:51:59.951485 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 506/1001] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:51:59 2022] GET /compute/v2.1/servers/722b88a8-8b51-445c-905e-8184f2411d12 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 08:52:00.369239 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6507b1a4-23e1-4832-a464-3069cbe01b5f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:52:00.369735 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.compute.api [None req-6507b1a4-23e1-4832-a464-3069cbe01b5f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] Fetching instance by UUID {{(pid=127298) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:52:00.376904 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6507b1a4-23e1-4832-a464-3069cbe01b5f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:52:00.377390 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6507b1a4-23e1-4832-a464-3069cbe01b5f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:52:00.377821 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6507b1a4-23e1-4832-a464-3069cbe01b5f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:52:00.378507 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6507b1a4-23e1-4832-a464-3069cbe01b5f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:52:00.378953 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6507b1a4-23e1-4832-a464-3069cbe01b5f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:52:00.379372 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG oslo_concurrency.lockutils [None req-6507b1a4-23e1-4832-a464-3069cbe01b5f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:52:00.393068 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.wsgi [None req-6507b1a4-23e1-4832-a464-3069cbe01b5f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] HTTP exception thrown: Instance 7121f229-54ff-4621-a114-ae43449afcaa could not be found. Aug 17 08:52:00.394713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6507b1a4-23e1-4832-a464-3069cbe01b5f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Request method failure captured: Aug 17 08:52:00.394713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: request: DELETE /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa HTTP/1.1 Aug 17 08:52:00.394713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept: application/json Aug 17 08:52:00.394713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Accept-Encoding: identity Aug 17 08:52:00.394713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Connection: close Aug 17 08:52:00.394713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Length: 0 Aug 17 08:52:00.394713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Content-Type: application/json Aug 17 08:52:00.394713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Host: 10.222.0.15 Aug 17 08:52:00.394713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Openstack-System-Scope: None Aug 17 08:52:00.394713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: User-Agent: python-urllib3/1.26.11 Aug 17 08:52:00.394713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Auth-Token: gAAAAABi_KqTOZHHp4exlO9JtJvsxhU-XYqXYc5SttvczNE_w4p59bh8OCi-5xACSgv1RbctOsIDt0kRSJzjpMlFSNXzpcJeMw2-2JfJKowdfVi05mnPbRPopenh1uAbG4FQG04MtNjR4cEOuEtLzb5kdwyG7jCh6ueGti39sT6TwiusrQr38WM Aug 17 08:52:00.394713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Id: None Aug 17 08:52:00.394713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Domain-Name: None Aug 17 08:52:00.394713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Identity-Status: Confirmed Aug 17 08:52:00.394713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Is-Admin-Project: True Aug 17 08:52:00.394713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Id: default Aug 17 08:52:00.394713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Domain-Name: Default Aug 17 08:52:00.394713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Id: e2604417eb5f48f0b026b00a9c164e08 Aug 17 08:52:00.394713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Project-Name: tempest-TestVolumeBootPattern-1304915916 Aug 17 08:52:00.394713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Role: member,reader Aug 17 08:52:00.394713 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Roles: member,reader Aug 17 08:52:00.396452 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e2604417eb5f48f0b026b00a9c164e08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e2604417eb5f48f0b026b00a9c164e08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e2604417eb5f48f0b026b00a9c164e08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e2604417eb5f48f0b026b00a9c164e08", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:52:00.396452 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant: tempest-TestVolumeBootPattern-1304915916 Aug 17 08:52:00.396452 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Id: e2604417eb5f48f0b026b00a9c164e08 Aug 17 08:52:00.396452 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-Tenant-Name: tempest-TestVolumeBootPattern-1304915916 Aug 17 08:52:00.396452 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User: tempest-TestVolumeBootPattern-1304915916-project Aug 17 08:52:00.396452 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Id: default Aug 17 08:52:00.396452 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Domain-Name: Default Aug 17 08:52:00.396452 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Id: 73a4f1987dda43068520217d36d99799 Aug 17 08:52:00.396452 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: X-User-Name: tempest-TestVolumeBootPattern-1304915916-project Aug 17 08:52:00.396452 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: method: > Aug 17 08:52:00.396452 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: exception: Instance 7121f229-54ff-4621-a114-ae43449afcaa could not be found. Aug 17 08:52:00.396452 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: action_args: {'id': '7121f229-54ff-4621-a114-ae43449afcaa'} Aug 17 08:52:00.397305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:52:00.397305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:52:00.397305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:52:00.397305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:52:00.397305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:52:00.397305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:52:00.397305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:52:00.397305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:52:00.397305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:52:00.397305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:52:00.397305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7121f229-54ff-4621-a114-ae43449afcaa could not be found. Aug 17 08:52:00.397305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:52:00.397305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:52:00.397305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:52:00.397305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:52:00.397305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:52:00.397305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:52:00.397305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:52:00.397305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:52:00.397305 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:52:00.398686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:52:00.398686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 08:52:00.398686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 08:52:00.398686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 08:52:00.398686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 08:52:00.398686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:52:00.398686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:52:00.398686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:52:00.398686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:52:00.398686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7121f229-54ff-4621-a114-ae43449afcaa could not be found. Aug 17 08:52:00.398686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:52:00.398686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:52:00.398686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:52:00.398686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:52:00.398686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:52:00.398686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:52:00.398686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:52:00.398686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:52:00.398686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7121f229-54ff-4621-a114-ae43449afcaa could not be found. Aug 17 08:52:00.398686 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: ERROR nova.api.openstack.wsgi Aug 17 08:52:00.400084 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-6507b1a4-23e1-4832-a464-3069cbe01b5f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Returning 404 to user: Instance 7121f229-54ff-4621-a114-ae43449afcaa could not be found. {{(pid=127298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:52:00.400084 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-6507b1a4-23e1-4832-a464-3069cbe01b5f tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa" status: 404 len: 111 microversion: 2.1 time: 0.030693 Aug 17 08:52:00.400084 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 496/1002] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 08:52:00 2022] DELETE /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 08:52:00.404683 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5d8cc2d7-6444-456b-a8d0-e44548ad4424 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '>' {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:52:00.405284 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.compute.api [None req-5d8cc2d7-6444-456b-a8d0-e44548ad4424 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] [instance: 7121f229-54ff-4621-a114-ae43449afcaa] Fetching instance by UUID {{(pid=127297) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 08:52:00.411076 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5d8cc2d7-6444-456b-a8d0-e44548ad4424 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:52:00.411562 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5d8cc2d7-6444-456b-a8d0-e44548ad4424 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:52:00.411996 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5d8cc2d7-6444-456b-a8d0-e44548ad4424 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:52:00.412666 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5d8cc2d7-6444-456b-a8d0-e44548ad4424 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Acquiring lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 08:52:00.413110 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5d8cc2d7-6444-456b-a8d0-e44548ad4424 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 08:52:00.413525 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG oslo_concurrency.lockutils [None req-5d8cc2d7-6444-456b-a8d0-e44548ad4424 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Lock "cf0f308f-a8b1-436d-b844-51a4a733ef03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 08:52:00.427123 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.wsgi [None req-5d8cc2d7-6444-456b-a8d0-e44548ad4424 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] HTTP exception thrown: Instance 7121f229-54ff-4621-a114-ae43449afcaa could not be found. Aug 17 08:52:00.428634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5d8cc2d7-6444-456b-a8d0-e44548ad4424 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Request method failure captured: Aug 17 08:52:00.428634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: request: GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa HTTP/1.1 Aug 17 08:52:00.428634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept: application/json Aug 17 08:52:00.428634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Accept-Encoding: identity Aug 17 08:52:00.428634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Connection: close Aug 17 08:52:00.428634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Length: 0 Aug 17 08:52:00.428634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Content-Type: application/json Aug 17 08:52:00.428634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Host: 10.222.0.15 Aug 17 08:52:00.428634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Openstack-System-Scope: None Aug 17 08:52:00.428634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: User-Agent: python-urllib3/1.26.11 Aug 17 08:52:00.428634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Auth-Token: gAAAAABi_KqTOZHHp4exlO9JtJvsxhU-XYqXYc5SttvczNE_w4p59bh8OCi-5xACSgv1RbctOsIDt0kRSJzjpMlFSNXzpcJeMw2-2JfJKowdfVi05mnPbRPopenh1uAbG4FQG04MtNjR4cEOuEtLzb5kdwyG7jCh6ueGti39sT6TwiusrQr38WM Aug 17 08:52:00.428634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Id: None Aug 17 08:52:00.428634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Domain-Name: None Aug 17 08:52:00.428634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Identity-Status: Confirmed Aug 17 08:52:00.428634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Is-Admin-Project: True Aug 17 08:52:00.428634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Id: default Aug 17 08:52:00.428634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Domain-Name: Default Aug 17 08:52:00.428634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Id: e2604417eb5f48f0b026b00a9c164e08 Aug 17 08:52:00.428634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Project-Name: tempest-TestVolumeBootPattern-1304915916 Aug 17 08:52:00.428634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Role: member,reader Aug 17 08:52:00.428634 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Roles: member,reader Aug 17 08:52:00.430272 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e2604417eb5f48f0b026b00a9c164e08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e2604417eb5f48f0b026b00a9c164e08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e2604417eb5f48f0b026b00a9c164e08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e2604417eb5f48f0b026b00a9c164e08", "adminURL": "http://10.222.0.15:8080"}]}] Aug 17 08:52:00.430272 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant: tempest-TestVolumeBootPattern-1304915916 Aug 17 08:52:00.430272 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Id: e2604417eb5f48f0b026b00a9c164e08 Aug 17 08:52:00.430272 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-Tenant-Name: tempest-TestVolumeBootPattern-1304915916 Aug 17 08:52:00.430272 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User: tempest-TestVolumeBootPattern-1304915916-project Aug 17 08:52:00.430272 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Id: default Aug 17 08:52:00.430272 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Domain-Name: Default Aug 17 08:52:00.430272 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Id: 73a4f1987dda43068520217d36d99799 Aug 17 08:52:00.430272 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: X-User-Name: tempest-TestVolumeBootPattern-1304915916-project Aug 17 08:52:00.430272 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: method: > Aug 17 08:52:00.430272 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: exception: Instance 7121f229-54ff-4621-a114-ae43449afcaa could not be found. Aug 17 08:52:00.430272 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: action_args: {'id': '7121f229-54ff-4621-a114-ae43449afcaa'} Aug 17 08:52:00.431065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: {{(pid=127297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 08:52:00.431065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:52:00.431065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 08:52:00.431065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 08:52:00.431065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 08:52:00.431065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 08:52:00.431065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 08:52:00.431065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 08:52:00.431065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 08:52:00.431065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 08:52:00.431065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7121f229-54ff-4621-a114-ae43449afcaa could not be found. Aug 17 08:52:00.431065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:52:00.431065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:52:00.431065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:52:00.431065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:52:00.431065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:52:00.431065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:52:00.431065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 08:52:00.431065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 08:52:00.431065 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 08:52:00.432554 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 08:52:00.432554 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 08:52:00.432554 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 08:52:00.432554 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 08:52:00.432554 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 08:52:00.432554 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 08:52:00.432554 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 08:52:00.432554 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7121f229-54ff-4621-a114-ae43449afcaa could not be found. Aug 17 08:52:00.432554 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:52:00.432554 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 08:52:00.432554 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:52:00.432554 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 08:52:00.432554 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 08:52:00.432554 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 08:52:00.432554 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 08:52:00.432554 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 08:52:00.432554 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7121f229-54ff-4621-a114-ae43449afcaa could not be found. Aug 17 08:52:00.432554 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: ERROR nova.api.openstack.wsgi Aug 17 08:52:00.434680 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: DEBUG nova.api.openstack.wsgi [None req-5d8cc2d7-6444-456b-a8d0-e44548ad4424 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Returning 404 to user: Instance 7121f229-54ff-4621-a114-ae43449afcaa could not be found. {{(pid=127297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 08:52:00.434680 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO nova.api.openstack.requestlog [None req-5d8cc2d7-6444-456b-a8d0-e44548ad4424 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa" status: 404 len: 111 microversion: 2.1 time: 0.029183 Aug 17 08:52:00.434680 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: [pid: 127297|app: 0|req: 507/1003] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 08:52:00 2022] GET /compute/v2.1/servers/7121f229-54ff-4621-a114-ae43449afcaa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 08:52:01.723391 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: DEBUG nova.api.openstack.wsgi [None req-1a35c71f-23da-4e07-8c0b-453af00f07d3 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] Calling method '.version_select at 0x7f3f8526d550>' {{(pid=127298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 08:52:01.742794 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO nova.api.openstack.requestlog [None req-1a35c71f-23da-4e07-8c0b-453af00f07d3 tempest-TestVolumeBootPattern-1304915916 tempest-TestVolumeBootPattern-1304915916-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-450789034" status: 202 len: 0 microversion: 2.1 time: 0.023196 Aug 17 08:52:01.743364 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: [pid: 127298|app: 0|req: 497/1004] 10.222.0.15 () {58 vars in 1260 bytes} [Wed Aug 17 08:52:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-450789034 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 08:52:57.350121 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 08:52:57.350763 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Wed Aug 17 08:52:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 08:52:57.432477 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 08:52:57.432939 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Wed Aug 17 08:52:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 08:53:29.570408 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 08:53:29.571033 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Wed Aug 17 08:53:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 08:54:34.800639 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 08:54:34.801099 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Wed Aug 17 08:54:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 08:54:52.094288 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 08:54:52.094912 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Wed Aug 17 08:54:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 08:54:54.337220 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 08:54:54.337856 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Wed Aug 17 08:54:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 08:56:17.358061 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 08:56:17.358789 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Wed Aug 17 08:56:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 08:56:17.440613 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 08:56:17.441083 dv-cinder-853315-5-iscsi devstack@n-api.service[127298]: Wed Aug 17 08:56:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 08:56:49.578971 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 08:56:49.579621 dv-cinder-853315-5-iscsi devstack@n-api.service[127297]: Wed Aug 17 08:56:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!